Sep 04 23:24:57 user nova-compute[72954]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Sep 04 23:25:00 user nova-compute[72954]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72954) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Sep 04 23:25:00 user nova-compute[72954]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72954) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Sep 04 23:25:00 user nova-compute[72954]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72954) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Sep 04 23:25:00 user nova-compute[72954]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Sep 04 23:25:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:25:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:25:01 user nova-compute[72954]: INFO nova.virt.driver [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Sep 04 23:25:01 user nova-compute[72954]: INFO nova.compute.provider_config [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Acquiring lock "singleton_lock" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Acquired lock "singleton_lock" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Releasing lock "singleton_lock" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Full set of CONF: {{(pid=72954) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ******************************************************************************** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Configuration options gathered from: {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ================================================================================ {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] allow_resize_to_same_host      = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] arq_binding_timeout            = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] backdoor_port                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] backdoor_socket                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] block_device_allocate_retries  = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] block_device_allocate_retries_interval = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cert                           = self.pem {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute_monitors               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] config_dir                     = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] config_drive_format            = iso9660 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] config_source                  = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] console_host                   = user {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] control_exchange               = nova {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cpu_allocation_ratio           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] daemon                         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] debug                          = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_access_ip_network_name = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_availability_zone      = nova {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_ephemeral_format       = ext4 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_green_pool_size        = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] default_schedule_zone          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] disk_allocation_ratio          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] enable_new_services            = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] enabled_ssl_apis               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] flat_injected                  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] force_config_drive             = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] force_raw_images               = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] graceful_shutdown_timeout      = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] heal_instance_info_cache_interval = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] host                           = user {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_build_timeout         = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_delete_interval       = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_name_template         = instance-%08x {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_usage_audit           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_usage_audit_period    = month {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] internal_service_availability_zone = internal {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] key                            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] live_migration_retry_count     = 30 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_config_append              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_dir                        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_file                       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_options                    = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_rotate_interval            = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_rotate_interval_type       = days {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] log_rotation_type              = none {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] long_rpc_timeout               = 1800 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_concurrent_builds          = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_concurrent_live_migrations = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_concurrent_snapshots       = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_local_block_devices        = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_logfile_count              = 30 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] max_logfile_size_mb            = 200 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] maximum_instance_delete_attempts = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metadata_listen                = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metadata_listen_port           = 8775 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metadata_workers               = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] migrate_max_retries            = -1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] mkisofs_cmd                    = genisoimage {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] my_ip                          = 10.0.0.210 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] network_allocate_retries       = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] osapi_compute_listen_port      = 8774 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] osapi_compute_unique_server_name_scope =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] osapi_compute_workers          = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] password_length                = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] periodic_enable                = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] periodic_fuzzy_delay           = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] pointer_model                  = ps2mouse {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] preallocate_images             = none {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] publish_errors                 = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] pybasedir                      = /opt/stack/nova {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ram_allocation_ratio           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rate_limit_burst               = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rate_limit_except_level        = CRITICAL {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rate_limit_interval            = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reboot_timeout                 = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reclaim_instance_interval      = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] record                         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reimage_timeout_per_gb         = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] report_interval                = 120 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rescue_timeout                 = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reserved_host_cpus             = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reserved_host_disk_mb          = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reserved_host_memory_mb        = 512 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] reserved_huge_pages            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] resize_confirm_window          = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] resize_fs_using_block_device   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] resume_guests_state_on_host_boot = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rpc_response_timeout           = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] run_external_periodic_tasks    = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] running_deleted_instance_action = reap {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] running_deleted_instance_timeout = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler_instance_sync_interval = 120 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_down_time              = 720 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] servicegroup_driver            = db {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] shelved_offload_time           = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] shelved_poll_interval          = 3600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] shutdown_timeout               = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] source_is_ipv6                 = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ssl_only                       = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] state_path                     = /opt/stack/data/nova {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] sync_power_state_interval      = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] sync_power_state_pool_size     = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] syslog_log_facility            = LOG_USER {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] tempdir                        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] timeout_nbd                    = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] transport_url                  = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] update_resources_interval      = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_cow_images                 = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_eventlog                   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_journal                    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_json                       = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_rootwrap_daemon            = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_stderr                     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] use_syslog                     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vcpu_pin_set                   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plugging_is_fatal          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plugging_timeout           = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] virt_mkfs                      = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] volume_usage_poll_interval     = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] watch_log_file                 = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] web                            = /usr/share/spice-html5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.auth_strategy              = keystone {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.compute_link_prefix        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.dhcp_domain                = novalocal {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.enable_instance_password   = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.glance_link_prefix         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.instance_list_per_project_cells = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.list_records_by_skipping_down_cells = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.local_metadata_per_cell    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.max_limit                  = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.metadata_cache_expiration  = 15 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.neutron_default_tenant_id  = default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.use_forwarded_for          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.use_neutron_default_nets   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_dynamic_targets = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_jsonfile_path   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.backend_argument         = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.config_prefix            = cache.oslo {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.dead_timeout             = 60.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.debug_cache_backend      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.enable_retry_client      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.enable_socket_keepalive  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.enabled                  = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.expiration_time          = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_dead_retry      = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_password        =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_sasl_enabled    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.memcache_username        =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.proxies                  = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.retry_attempts           = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.retry_delay              = 0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.socket_keepalive_count   = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.socket_keepalive_idle    = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.socket_keepalive_interval = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.tls_allowed_ciphers      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.tls_cafile               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.tls_certfile             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.tls_enabled              = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cache.tls_keyfile              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.auth_section            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.auth_type               = password {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.cafile                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.certfile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.collect_timing          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.cross_az_attach         = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.debug                   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.endpoint_template       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.http_retries            = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.insecure                = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.keyfile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.os_region_name          = RegionOne {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.split_loggers           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cinder.timeout                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.cpu_dedicated_set      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.cpu_shared_set         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.image_type_exclude_list = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.resource_provider_association_refresh = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.shutdown_retry_interval = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] conductor.workers              = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] console.allowed_origins        = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] console.ssl_ciphers            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] console.ssl_minimum_version    = default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] consoleauth.token_ttl          = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.cafile                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.certfile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.collect_timing          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.connect_retries         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.connect_retry_delay     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.endpoint_override       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.insecure                = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.keyfile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.max_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.min_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.region_name             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.service_name            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.service_type            = accelerator {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.split_loggers           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.status_code_retries     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.timeout                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] cyborg.version                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.backend               = sqlalchemy {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.connection            = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.connection_debug      = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.connection_parameters =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.connection_recycle_time = 3600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.connection_trace      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.db_inc_retry_interval = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.db_max_retries        = 20 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.db_max_retry_interval = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.db_retry_interval     = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.max_overflow          = 50 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.max_pool_size         = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.max_retries           = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.mysql_enable_ndb      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.pool_timeout          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.retry_interval        = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.slave_connection      = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] database.sqlite_synchronous    = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.backend           = sqlalchemy {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.connection        = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.connection_debug  = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.connection_parameters =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.connection_recycle_time = 3600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.connection_trace  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.db_inc_retry_interval = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.db_max_retries    = 20 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.db_max_retry_interval = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.db_retry_interval = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.max_overflow      = 50 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.max_pool_size     = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.max_retries       = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.mysql_enable_ndb  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.pool_timeout      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.retry_interval    = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.slave_connection  = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] api_database.sqlite_synchronous = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] devices.enabled_mdev_types     = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ephemeral_storage_encryption.enabled = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.api_servers             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.cafile                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.certfile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.collect_timing          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.connect_retries         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.connect_retry_delay     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.debug                   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.default_trusted_certificate_ids = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.enable_certificate_validation = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.enable_rbd_download     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.endpoint_override       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.insecure                = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.keyfile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.max_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.min_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.num_retries             = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.rbd_ceph_conf           =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.rbd_connect_timeout     = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.rbd_pool                =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.rbd_user                =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.region_name             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.service_name            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.service_type            = image {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.split_loggers           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.status_code_retries     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.timeout                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.verify_glance_signatures = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] glance.version                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] guestfs.debug                  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.config_drive_cdrom      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.config_drive_inject_password = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.enable_remotefx         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.instances_path_share    =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.limit_cpu_features      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.use_multipath_io        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.vswitch_name            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] mks.enabled                    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.manager_interval   = 2400 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.precache_concurrency = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.remove_unused_base_images = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] image_cache.subdirectory_name  = _base {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.api_max_retries         = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.api_retry_interval      = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.auth_section            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.auth_type               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.cafile                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.certfile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.collect_timing          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.conductor_group         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.connect_retries         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.connect_retry_delay     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.endpoint_override       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.insecure                = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.keyfile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.max_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.min_version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.peer_list               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.region_name             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.serial_console_state_timeout = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.service_name            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.service_type            = baremetal {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.shard                   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.split_loggers           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.status_code_retries     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.timeout                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ironic.version                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] key_manager.fixed_key          = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.barbican_api_version  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.barbican_endpoint     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.barbican_endpoint_type = public {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.barbican_region_name  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.cafile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.certfile              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.collect_timing        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.insecure              = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.keyfile               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.number_of_retries     = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.retry_delay           = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.send_service_user_token = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.split_loggers         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.timeout               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.verify_ssl            = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican.verify_ssl_path       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.auth_section = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.auth_type = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.cafile   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.certfile = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.collect_timing = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.insecure = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.keyfile  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.split_loggers = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] barbican_service_user.timeout  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.approle_role_id          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.approle_secret_id        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.cafile                   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.certfile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.collect_timing           = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.insecure                 = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.keyfile                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.kv_mountpoint            = secret {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.kv_version               = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.namespace                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.root_token_id            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.split_loggers            = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.ssl_ca_crt_file          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.timeout                  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.use_ssl                  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.auth_section          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.auth_type             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.cafile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.certfile              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.collect_timing        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.connect_retries       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.connect_retry_delay   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.endpoint_override     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.insecure              = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.keyfile               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.max_version           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.min_version           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.region_name           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.service_name          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.service_type          = identity {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.split_loggers         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.status_code_retries   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.timeout               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] keystone.version               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.connection_uri         =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_mode               = custom {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: WARNING oslo_config.cfg [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_power_governor_high = performance {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_power_management   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.device_detach_attempts = 8 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.device_detach_timeout  = 20 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.disk_cachemodes        = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.disk_prefix            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.enabled_perf_events    = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.file_backed_memory     = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.gid_maps               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.hw_disk_discard        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.hw_machine_type        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_rbd_pool        = rbd {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_type            = default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.images_volume_group    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.inject_key             = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.inject_partition       = -2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.inject_password        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.iscsi_iface            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.iser_use_multipath     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_downtime = 500 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_inbound_addr = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_scheme  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_timeout_action = abort {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_tunnelled = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: WARNING oslo_config.cfg [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Sep 04 23:25:01 user nova-compute[72954]: live_migration_uri is deprecated for removal in favor of two other options that
Sep 04 23:25:01 user nova-compute[72954]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Sep 04 23:25:01 user nova-compute[72954]: and ``live_migration_inbound_addr`` respectively.
Sep 04 23:25:01 user nova-compute[72954]: ).  Its value may be silently ignored in the future.
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.live_migration_with_native_tls = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.max_queues             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.nfs_mount_options      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_pcie_ports         = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.pmem_namespaces        = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.quobyte_client_cfg     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rbd_secret_uuid        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rbd_user               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rescue_image_id        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rescue_kernel_id       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.rx_queue_size          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.smbfs_mount_options    =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.snapshot_compression   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.snapshot_image_format  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.sparse_logical_volumes = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.swtpm_enabled          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.swtpm_group            = tss {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.swtpm_user             = tss {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.sysinfo_serial         = unique {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.tb_cache_size          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.tx_queue_size          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.uid_maps               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.use_virtio_for_bridges = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.virt_type              = kvm {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.volume_clear           = zero {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.volume_clear_size      = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.volume_use_multipath   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_cache_path   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.auth_section           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.auth_type              = password {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.cafile                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.certfile               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.collect_timing         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.connect_retries        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.connect_retry_delay    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.default_floating_pool  = public {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.endpoint_override      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.extension_sync_interval = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.http_retries           = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.insecure               = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.keyfile                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.max_version            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.min_version            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.ovs_bridge             = br-int {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.physnets               = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.region_name            = RegionOne {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.service_metadata_proxy = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.service_name           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.service_type           = network {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.split_loggers          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.status_code_retries    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.timeout                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] neutron.version                = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] notifications.bdms_in_notifications = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] notifications.default_level    = INFO {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] notifications.notification_format = unversioned {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] notifications.notify_on_state_change = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] pci.alias                      = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] pci.device_spec                = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] pci.report_in_placement        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.auth_section         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.auth_type            = password {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.cafile               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.certfile             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.collect_timing       = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.connect_retries      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.connect_retry_delay  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.default_domain_id    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.default_domain_name  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.domain_id            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.domain_name          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.endpoint_override    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.insecure             = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.keyfile              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.max_version          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.min_version          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.password             = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.project_domain_id    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.project_domain_name  = Default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.project_id           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.project_name         = service {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.region_name          = RegionOne {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.service_name         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.service_type         = placement {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.split_loggers        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.status_code_retries  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.system_scope         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.timeout              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.trust_id             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.user_domain_id       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.user_domain_name     = Default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.user_id              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.username             = placement {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] placement.version              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.cores                    = 20 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.count_usage_from_placement = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.injected_file_content_bytes = 10240 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.injected_file_path_length = 255 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.injected_files           = 5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.instances                = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.key_pairs                = 100 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.metadata_items           = 128 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.ram                      = 51200 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.recheck_quota            = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.server_group_members     = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] quota.server_groups            = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rdp.enabled                    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.image_metadata_prefilter = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.max_attempts         = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.max_placement_results = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] scheduler.workers              = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.host_subset_size = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.isolated_hosts = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.isolated_images = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.pci_in_placement = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.track_instance_changes = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metrics.required               = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metrics.weight_multiplier      = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] metrics.weight_setting         = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.enabled         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.port_range      = 10000:20000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] serial_console.serialproxy_port = 6083 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.auth_section      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.auth_type         = password {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.cafile            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.certfile          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.collect_timing    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.insecure          = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.keyfile           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.send_service_user_token = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.split_loggers     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] service_user.timeout           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.agent_enabled            = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.enabled                  = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.html5proxy_port          = 6082 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.image_compression        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.jpeg_compression         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.playback_compression     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.server_listen            = 127.0.0.1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.streaming_mode           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] spice.zlib_compression         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] upgrade_levels.baseapi         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] upgrade_levels.cert            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] upgrade_levels.compute         = auto {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] upgrade_levels.conductor       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] upgrade_levels.scheduler       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.cafile = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.certfile = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.insecure = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vendordata_dynamic_auth.timeout = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.api_retry_count         = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.ca_file                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.cache_prefix            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.cluster_name            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.connection_pool_size    = 10 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.console_delay_seconds   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.datastore_regex         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.host_ip                 = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.host_password           = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.host_port               = 443 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.host_username           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.insecure                = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.integration_bridge      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.maximum_objects         = 100 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.pbm_default_policy      = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.pbm_enabled             = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.pbm_wsdl_location       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.serial_port_proxy_uri   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.serial_port_service_uri = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.task_poll_interval      = 0.5 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.use_linked_clone        = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.vnc_keymap              = en-us {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.vnc_port                = 5900 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vmware.vnc_port_total          = 10000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.auth_schemes               = ['none'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.enabled                    = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.novncproxy_port            = 6080 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.vencrypt_ca_certs          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.vencrypt_client_cert       = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vnc.vencrypt_client_key        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.disable_rootwrap   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.enable_numa_live_migration = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.libvirt_disable_apic = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.client_socket_timeout     = 900 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.default_pool_size         = 1000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.keep_alive                = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.max_header_line           = 16384 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.ssl_ca_file               = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.ssl_cert_file             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.ssl_key_file              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.tcp_keepidle              = 600 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] zvm.ca_file                    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] zvm.cloud_connector_url        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] zvm.reachable_timeout          = 300 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.enforce_new_defaults = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.enforce_scope      = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.policy_default_rule = default {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.connection_string     = messaging:// {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.enabled               = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.es_doc_type           = notification {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.es_scroll_size        = 10000 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.es_scroll_time        = 2m {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.filter_error_trace    = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.hmac_keys             = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.sentinel_service_name = mymaster {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.socket_timeout        = 0.1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.trace_requests        = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler.trace_sqlalchemy      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler_jaeger.process_tags   = {} {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] profiler_otlp.service_name_prefix = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] remote_debug.host              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] remote_debug.port              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.auth_section        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.auth_type           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.cafile              = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.certfile            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.collect_timing      = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.connect_retries     = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.connect_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.endpoint_id         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.endpoint_override   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.insecure            = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.keyfile             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.max_version         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.min_version         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.region_name         = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.service_name        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.service_type        = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.split_loggers       = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.status_code_retries = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.status_code_retry_delay = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.timeout             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.valid_interfaces    = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_limit.version             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_reports.file_event_handler = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] oslo_reports.log_dir           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.group  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] vif_plug_ovs_privileged.user   = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.isolate_vif         = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] os_brick.lock_path             = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.capabilities   = [21] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.group          = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.helper_command = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] privsep_osbrick.user           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.group           = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.helper_command  = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] nova_sys_admin.user            = None {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG oslo_service.service [None req-425df7af-b131-4051-a514-7f3551446ea3 None None] ******************************************************************************** {{(pid=72954) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Sep 04 23:25:01 user nova-compute[72954]: INFO nova.service [-] Starting compute node (version 0.0.0)
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Starting native event thread {{(pid=72954) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Starting green dispatch thread {{(pid=72954) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Starting connection event dispatch thread {{(pid=72954) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Connecting to libvirt: qemu:///system {{(pid=72954) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd1398c5d50> {{(pid=72954) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd1398c5d50> {{(pid=72954) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Sep 04 23:25:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Connection event '1' reason 'None'
Sep 04 23:25:01 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Sep 04 23:25:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.mount [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Initialising _HostMountState generation 0 {{(pid=72954) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Sep 04 23:25:08 user nova-compute[72954]: INFO nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host capabilities <capabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <host>
Sep 04 23:25:08 user nova-compute[72954]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Sep 04 23:25:08 user nova-compute[72954]:     <cpu>
Sep 04 23:25:08 user nova-compute[72954]:       <arch>x86_64</arch>
Sep 04 23:25:08 user nova-compute[72954]:       <model>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <microcode version='1070'/>
Sep 04 23:25:08 user nova-compute[72954]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Sep 04 23:25:08 user nova-compute[72954]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='osxsave'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='invtsc'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='rsba'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature name='skip-l1dfl-vmentry'/>
Sep 04 23:25:08 user nova-compute[72954]:       <pages unit='KiB' size='4'/>
Sep 04 23:25:08 user nova-compute[72954]:       <pages unit='KiB' size='2048'/>
Sep 04 23:25:08 user nova-compute[72954]:     </cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <power_management>
Sep 04 23:25:08 user nova-compute[72954]:       <suspend_mem/>
Sep 04 23:25:08 user nova-compute[72954]:       <suspend_disk/>
Sep 04 23:25:08 user nova-compute[72954]:       <suspend_hybrid/>
Sep 04 23:25:08 user nova-compute[72954]:     </power_management>
Sep 04 23:25:08 user nova-compute[72954]:     <iommu support='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <migration_features>
Sep 04 23:25:08 user nova-compute[72954]:       <live/>
Sep 04 23:25:08 user nova-compute[72954]:       <uri_transports>
Sep 04 23:25:08 user nova-compute[72954]:         <uri_transport>tcp</uri_transport>
Sep 04 23:25:08 user nova-compute[72954]:         <uri_transport>rdma</uri_transport>
Sep 04 23:25:08 user nova-compute[72954]:       </uri_transports>
Sep 04 23:25:08 user nova-compute[72954]:     </migration_features>
Sep 04 23:25:08 user nova-compute[72954]:     <topology>
Sep 04 23:25:08 user nova-compute[72954]:       <cells num='2'>
Sep 04 23:25:08 user nova-compute[72954]:         <cell id='0'>
Sep 04 23:25:08 user nova-compute[72954]:           <memory unit='KiB'>8140616</memory>
Sep 04 23:25:08 user nova-compute[72954]:           <pages unit='KiB' size='4'>2035154</pages>
Sep 04 23:25:08 user nova-compute[72954]:           <pages unit='KiB' size='2048'>0</pages>
Sep 04 23:25:08 user nova-compute[72954]:           <distances>
Sep 04 23:25:08 user nova-compute[72954]:             <sibling id='0' value='10'/>
Sep 04 23:25:08 user nova-compute[72954]:             <sibling id='1' value='20'/>
Sep 04 23:25:08 user nova-compute[72954]:           </distances>
Sep 04 23:25:08 user nova-compute[72954]:           <cpus num='6'>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Sep 04 23:25:08 user nova-compute[72954]:           </cpus>
Sep 04 23:25:08 user nova-compute[72954]:         </cell>
Sep 04 23:25:08 user nova-compute[72954]:         <cell id='1'>
Sep 04 23:25:08 user nova-compute[72954]:           <memory unit='KiB'>8255068</memory>
Sep 04 23:25:08 user nova-compute[72954]:           <pages unit='KiB' size='4'>2063767</pages>
Sep 04 23:25:08 user nova-compute[72954]:           <pages unit='KiB' size='2048'>0</pages>
Sep 04 23:25:08 user nova-compute[72954]:           <distances>
Sep 04 23:25:08 user nova-compute[72954]:             <sibling id='0' value='20'/>
Sep 04 23:25:08 user nova-compute[72954]:             <sibling id='1' value='10'/>
Sep 04 23:25:08 user nova-compute[72954]:           </distances>
Sep 04 23:25:08 user nova-compute[72954]:           <cpus num='6'>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Sep 04 23:25:08 user nova-compute[72954]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Sep 04 23:25:08 user nova-compute[72954]:           </cpus>
Sep 04 23:25:08 user nova-compute[72954]:         </cell>
Sep 04 23:25:08 user nova-compute[72954]:       </cells>
Sep 04 23:25:08 user nova-compute[72954]:     </topology>
Sep 04 23:25:08 user nova-compute[72954]:     <cache>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Sep 04 23:25:08 user nova-compute[72954]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Sep 04 23:25:08 user nova-compute[72954]:     </cache>
Sep 04 23:25:08 user nova-compute[72954]:     <secmodel>
Sep 04 23:25:08 user nova-compute[72954]:       <model>apparmor</model>
Sep 04 23:25:08 user nova-compute[72954]:       <doi>0</doi>
Sep 04 23:25:08 user nova-compute[72954]:     </secmodel>
Sep 04 23:25:08 user nova-compute[72954]:     <secmodel>
Sep 04 23:25:08 user nova-compute[72954]:       <model>dac</model>
Sep 04 23:25:08 user nova-compute[72954]:       <doi>0</doi>
Sep 04 23:25:08 user nova-compute[72954]:       <baselabel type='kvm'>+64055:+108</baselabel>
Sep 04 23:25:08 user nova-compute[72954]:       <baselabel type='qemu'>+64055:+108</baselabel>
Sep 04 23:25:08 user nova-compute[72954]:     </secmodel>
Sep 04 23:25:08 user nova-compute[72954]:   </host>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='alpha'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>clipper</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='armv6l'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>integratorcp</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>ast2600-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>borzoi</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>spitz</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>nuri</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>romulus-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>npcm750-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>rainier-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps3-an547</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-b1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatileab</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>kzm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-a</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>smdkc210</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>imx25-pdk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>orangepi-pc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>z2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>tosa</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps2-an521</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>sabrelite</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an511</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>canon-a1100</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-eb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>emcraft-sf2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-pb-a8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi1ap</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>palmetto-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1-v1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n810</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g220a-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>tacoma-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gsj</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatilepb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>terrier</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mainstone</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps3-an524</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>kudo-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>midway</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>musicpal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s811evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s6965evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>microbit</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an505</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an385</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cubieboard</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>verdex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduino2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an386</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>raspi2b</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a15</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>fuji-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cheetah</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ast2500-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>highbank</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>akita</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>connex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduinoplus2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>collie</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='armv7l'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>integratorcp</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>ast2600-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>borzoi</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>spitz</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>nuri</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>romulus-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>npcm750-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>rainier-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps3-an547</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-b1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatileab</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>kzm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-a</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>smdkc210</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>imx25-pdk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>orangepi-pc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>z2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>tosa</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps2-an521</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>sabrelite</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an511</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>canon-a1100</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-eb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>emcraft-sf2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-pb-a8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi1ap</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>palmetto-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1-v1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n810</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g220a-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>tacoma-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gsj</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatilepb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>terrier</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mainstone</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps3-an524</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>kudo-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>midway</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>musicpal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s811evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s6965evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>microbit</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an505</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an385</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cubieboard</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>verdex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduino2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an386</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>raspi2b</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a15</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>fuji-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cheetah</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ast2500-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>highbank</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>akita</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>connex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduinoplus2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>collie</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='aarch64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>integratorcp</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>ast2600-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>borzoi</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>spitz</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>nuri</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>romulus-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>npcm750-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>rainier-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps3-an547</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-b1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatileab</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>kzm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>musca-a</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>smdkc210</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>imx25-pdk</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>orangepi-pc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>z2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>tosa</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps2-an521</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>sabrelite</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an511</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>canon-a1100</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-eb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>emcraft-sf2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>realview-pb-a8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>sbsa-ref</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi1ap</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>palmetto-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sx1-v1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n810</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g220a-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>n800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>tacoma-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>quanta-gsj</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>versatilepb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>terrier</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mainstone</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>mps3-an524</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>kudo-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>midway</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>musicpal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s811evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>lm3s6965evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>microbit</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an505</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an385</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>raspi3ap</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cubieboard</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>verdex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduino2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mps2-an386</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>raspi3b</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>raspi2b</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>vexpress-a15</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2'>fuji-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='512'>virt-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>cheetah</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>virt-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ast2500-evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>highbank</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>akita</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>connex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>netduinoplus2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>collie</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>raspi0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <acpi default='on' toggle='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='cris'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>axis-dev88</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='i686'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>x-remote</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>isapc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>microvm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='kvm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <pae/>
Sep 04 23:25:08 user nova-compute[72954]:       <nonpae/>
Sep 04 23:25:08 user nova-compute[72954]:       <acpi default='on' toggle='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:       <apic default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='m68k'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mcf5208evb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>an5206</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virt-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>q800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virt-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>next-cube</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virt-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='microblaze'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>petalogix-ml605</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='microblazeel'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>petalogix-ml605</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='mips'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>malta</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mipssim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='mipsel'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>malta</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mipssim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='mips64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>malta</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mipssim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>pica61</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>magnum</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='mips64el'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>malta</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>loongson3-virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mipssim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>pica61</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>magnum</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='16'>boston</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>fuloong2e</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='ppc'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g3beige</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virtex-ml507</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mac99</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ppce500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>pegasos2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sam460ex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>bamboo</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>40p</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ref405ep</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='15'>mpc8544ds</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>taihu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='ppc64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>taihu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='15'>mpc8544ds</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ppce500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>40p</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>pegasos2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>bamboo</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g3beige</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virtex-ml507</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mac99</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sam460ex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ref405ep</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='ppc64le'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>taihu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='15'>mpc8544ds</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ppce500</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>40p</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>pegasos2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>bamboo</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>g3beige</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>virtex-ml507</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>mac99</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sam460ex</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>ref405ep</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2048'>powernv8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='riscv32'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='8'>spike</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>opentitan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='5'>sifive_u</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sifive_e</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='8'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='riscv64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='8'>spike</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='5'>sifive_u</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>shakti_c</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sifive_e</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='8'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='s390x'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='sh4'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>shix</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>r2d</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='sh4eb'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>shix</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>r2d</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='sparc'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>SS-5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>SS-20</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>LX</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>SPARCClassic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>leon3_generic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>SPARCbook</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>SS-4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>SS-600MP</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>SS-10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>Voyager</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='sparc64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sun4u</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>niagara</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>sun4v</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='x86_64'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>64</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>x-remote</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='1'>isapc</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-focal</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>microvm</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='kvm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <acpi default='on' toggle='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:       <apic default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='xtensa'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>sim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>kc705</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ml605</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ml605-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx60-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx200</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx200-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx60</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>kc705-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]:   <guest>
Sep 04 23:25:08 user nova-compute[72954]:     <os_type>hvm</os_type>
Sep 04 23:25:08 user nova-compute[72954]:     <arch name='xtensaeb'>
Sep 04 23:25:08 user nova-compute[72954]:       <wordsize>32</wordsize>
Sep 04 23:25:08 user nova-compute[72954]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='4'>sim</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>kc705</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ml605</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>ml605-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>virt</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx60-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx200</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx200-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>lx60</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <machine maxCpus='32'>kc705-nommu</machine>
Sep 04 23:25:08 user nova-compute[72954]:       <domain type='qemu'/>
Sep 04 23:25:08 user nova-compute[72954]:     </arch>
Sep 04 23:25:08 user nova-compute[72954]:     <features>
Sep 04 23:25:08 user nova-compute[72954]:       <cpuselection/>
Sep 04 23:25:08 user nova-compute[72954]:       <deviceboot/>
Sep 04 23:25:08 user nova-compute[72954]:       <disksnapshot default='on' toggle='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     </features>
Sep 04 23:25:08 user nova-compute[72954]:   </guest>
Sep 04 23:25:08 user nova-compute[72954]: </capabilities>
Sep 04 23:25:08 user nova-compute[72954]: 
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-i386</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-q35-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>i686</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='288'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'/>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='lm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </disk>
Sep 04 23:25:08 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </graphics>
Sep 04 23:25:08 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </video>
Sep 04 23:25:08 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:08 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:08 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </rng>
Sep 04 23:25:08 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:08 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </tpm>
Sep 04 23:25:08 user nova-compute[72954]:   </devices>
Sep 04 23:25:08 user nova-compute[72954]:   <features>
Sep 04 23:25:08 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:   </features>
Sep 04 23:25:08 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-i386</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-q35-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>i686</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='288'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'/>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='lm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </disk>
Sep 04 23:25:08 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </graphics>
Sep 04 23:25:08 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </video>
Sep 04 23:25:08 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:08 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:08 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </rng>
Sep 04 23:25:08 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:08 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </tpm>
Sep 04 23:25:08 user nova-compute[72954]:   </devices>
Sep 04 23:25:08 user nova-compute[72954]:   <features>
Sep 04 23:25:08 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:   </features>
Sep 04 23:25:08 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-i386</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-i440fx-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>i686</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='255'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'/>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='lm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ide</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </disk>
Sep 04 23:25:08 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </graphics>
Sep 04 23:25:08 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </video>
Sep 04 23:25:08 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:08 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:08 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </rng>
Sep 04 23:25:08 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:08 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </tpm>
Sep 04 23:25:08 user nova-compute[72954]:   </devices>
Sep 04 23:25:08 user nova-compute[72954]:   <features>
Sep 04 23:25:08 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:   </features>
Sep 04 23:25:08 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-i386</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-i440fx-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>i686</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='255'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'/>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='lm'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ide</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </disk>
Sep 04 23:25:08 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </graphics>
Sep 04 23:25:08 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </video>
Sep 04 23:25:08 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:08 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:08 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </rng>
Sep 04 23:25:08 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:08 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </tpm>
Sep 04 23:25:08 user nova-compute[72954]:   </devices>
Sep 04 23:25:08 user nova-compute[72954]:   <features>
Sep 04 23:25:08 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:   </features>
Sep 04 23:25:08 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-x86_64</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-q35-6.2</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>x86_64</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='288'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>efi</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='invtsc'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='rsba'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pschange-mc-no'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </disk>
Sep 04 23:25:08 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </graphics>
Sep 04 23:25:08 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </video>
Sep 04 23:25:08 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:08 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:08 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </rng>
Sep 04 23:25:08 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:08 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </tpm>
Sep 04 23:25:08 user nova-compute[72954]:   </devices>
Sep 04 23:25:08 user nova-compute[72954]:   <features>
Sep 04 23:25:08 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:08 user nova-compute[72954]:   </features>
Sep 04 23:25:08 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Sep 04 23:25:08 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:08 user nova-compute[72954]:   <path>/usr/bin/qemu-system-x86_64</path>
Sep 04 23:25:08 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:08 user nova-compute[72954]:   <machine>pc-q35-jammy</machine>
Sep 04 23:25:08 user nova-compute[72954]:   <arch>x86_64</arch>
Sep 04 23:25:08 user nova-compute[72954]:   <vcpu max='288'/>
Sep 04 23:25:08 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:08 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='firmware'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>efi</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </loader>
Sep 04 23:25:08 user nova-compute[72954]:   </os>
Sep 04 23:25:08 user nova-compute[72954]:   <cpu>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='invtsc'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='rsba'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='require' name='pschange-mc-no'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:08 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm64</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>core2duo</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Westmere-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Westmere</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Penryn</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Opteron_G1</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Nehalem-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Nehalem</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>Conroe</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:08 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:08 user nova-compute[72954]:     </mode>
Sep 04 23:25:08 user nova-compute[72954]:   </cpu>
Sep 04 23:25:08 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:08 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:08 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:08 user nova-compute[72954]:     </enum>
Sep 04 23:25:08 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:08 user nova-compute[72954]:   <devices>
Sep 04 23:25:08 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:08 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:08 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:08 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:08 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </disk>
Sep 04 23:25:09 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </graphics>
Sep 04 23:25:09 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </video>
Sep 04 23:25:09 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:09 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:09 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </rng>
Sep 04 23:25:09 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:09 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </tpm>
Sep 04 23:25:09 user nova-compute[72954]:   </devices>
Sep 04 23:25:09 user nova-compute[72954]:   <features>
Sep 04 23:25:09 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:   </features>
Sep 04 23:25:09 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:09 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Sep 04 23:25:09 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:09 user nova-compute[72954]:   <path>/usr/bin/qemu-system-x86_64</path>
Sep 04 23:25:09 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:09 user nova-compute[72954]:   <machine>pc-i440fx-6.2</machine>
Sep 04 23:25:09 user nova-compute[72954]:   <arch>x86_64</arch>
Sep 04 23:25:09 user nova-compute[72954]:   <vcpu max='255'/>
Sep 04 23:25:09 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:     <enum name='firmware'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>efi</value>
Sep 04 23:25:09 user nova-compute[72954]:     </enum>
Sep 04 23:25:09 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </loader>
Sep 04 23:25:09 user nova-compute[72954]:   </os>
Sep 04 23:25:09 user nova-compute[72954]:   <cpu>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='invtsc'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='rsba'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='pschange-mc-no'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>kvm64</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>core2duo</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Westmere-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Westmere</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Penryn</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Opteron_G1</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Nehalem-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Nehalem</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Conroe</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:   </cpu>
Sep 04 23:25:09 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:09 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:09 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:09 user nova-compute[72954]:     </enum>
Sep 04 23:25:09 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:09 user nova-compute[72954]:   <devices>
Sep 04 23:25:09 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>ide</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </disk>
Sep 04 23:25:09 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </graphics>
Sep 04 23:25:09 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </video>
Sep 04 23:25:09 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:09 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:09 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </rng>
Sep 04 23:25:09 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:09 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </tpm>
Sep 04 23:25:09 user nova-compute[72954]:   </devices>
Sep 04 23:25:09 user nova-compute[72954]:   <features>
Sep 04 23:25:09 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:   </features>
Sep 04 23:25:09 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:09 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Sep 04 23:25:09 user nova-compute[72954]: <domainCapabilities>
Sep 04 23:25:09 user nova-compute[72954]:   <path>/usr/bin/qemu-system-x86_64</path>
Sep 04 23:25:09 user nova-compute[72954]:   <domain>kvm</domain>
Sep 04 23:25:09 user nova-compute[72954]:   <machine>pc-i440fx-jammy</machine>
Sep 04 23:25:09 user nova-compute[72954]:   <arch>x86_64</arch>
Sep 04 23:25:09 user nova-compute[72954]:   <vcpu max='255'/>
Sep 04 23:25:09 user nova-compute[72954]:   <iothreads supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:   <os supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:     <enum name='firmware'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>efi</value>
Sep 04 23:25:09 user nova-compute[72954]:     </enum>
Sep 04 23:25:09 user nova-compute[72954]:     <loader supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>rom</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>pflash</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='readonly'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>yes</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='secure'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>no</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </loader>
Sep 04 23:25:09 user nova-compute[72954]:   </os>
Sep 04 23:25:09 user nova-compute[72954]:   <cpu>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='host-passthrough' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='hostPassthroughMigratable'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='maximum' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='maximumMigratable'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>on</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>off</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='host-model' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <vendor>Intel</vendor>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ss'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='vmx'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='pcid'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='hypervisor'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='arat'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='tsc_adjust'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='umip'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='md-clear'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='stibp'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='arch-capabilities'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ssbd'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='invtsc'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ibpb'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='ibrs'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='amd-stibp'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='amd-ssbd'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='rsba'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='require' name='pschange-mc-no'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='disable' name='erms'/>
Sep 04 23:25:09 user nova-compute[72954]:       <feature policy='disable' name='xsaveopt'/>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:     <mode name='custom' supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>qemu64</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>qemu32</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>phenom</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium3</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium2</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>pentium</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>n270</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>kvm64</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>kvm32</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>coreduo</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>core2duo</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>athlon</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Westmere-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Westmere</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Snowridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Skylake-Client</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>SandyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>SandyBridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Penryn</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G5</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G4</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G3</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Opteron_G2</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Opteron_G1</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Nehalem-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Nehalem</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>IvyBridge-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>IvyBridge</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Icelake-Server-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Icelake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Haswell</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-Rome</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-Milan</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC-IBPB</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>EPYC</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Dhyana</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cooperlake</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>Conroe</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Cascadelake-Server</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-noTSX</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell-IBRS</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='no'>Broadwell</model>
Sep 04 23:25:09 user nova-compute[72954]:       <model usable='yes'>486</model>
Sep 04 23:25:09 user nova-compute[72954]:     </mode>
Sep 04 23:25:09 user nova-compute[72954]:   </cpu>
Sep 04 23:25:09 user nova-compute[72954]:   <memoryBacking supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:     <enum name='sourceType'>
Sep 04 23:25:09 user nova-compute[72954]:       <value>file</value>
Sep 04 23:25:09 user nova-compute[72954]:       <value>anonymous</value>
Sep 04 23:25:09 user nova-compute[72954]:       <value>memfd</value>
Sep 04 23:25:09 user nova-compute[72954]:     </enum>
Sep 04 23:25:09 user nova-compute[72954]:   </memoryBacking>
Sep 04 23:25:09 user nova-compute[72954]:   <devices>
Sep 04 23:25:09 user nova-compute[72954]:     <disk supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='diskDevice'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>disk</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>cdrom</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>floppy</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>lun</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='bus'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>ide</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>fdc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sata</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </disk>
Sep 04 23:25:09 user nova-compute[72954]:     <graphics supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='type'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>sdl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vnc</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>spice</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egl-headless</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </graphics>
Sep 04 23:25:09 user nova-compute[72954]:     <video supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='modelType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>cirrus</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>vmvga</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>qxl</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>none</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>bochs</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>ramfb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </video>
Sep 04 23:25:09 user nova-compute[72954]:     <hostdev supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='mode'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>subsystem</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='startupPolicy'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>default</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>mandatory</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>requisite</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>optional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='subsysType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>usb</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>pci</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>scsi</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='capsType'/>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='pciBackend'/>
Sep 04 23:25:09 user nova-compute[72954]:     </hostdev>
Sep 04 23:25:09 user nova-compute[72954]:     <rng supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtio-non-transitional</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>random</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>egd</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>builtin</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </rng>
Sep 04 23:25:09 user nova-compute[72954]:     <filesystem supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='driverType'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>path</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>handle</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>virtiofs</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </filesystem>
Sep 04 23:25:09 user nova-compute[72954]:     <tpm supported='yes'>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='model'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-tis</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>tpm-crb</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:       <enum name='backendModel'>
Sep 04 23:25:09 user nova-compute[72954]:         <value>passthrough</value>
Sep 04 23:25:09 user nova-compute[72954]:         <value>emulator</value>
Sep 04 23:25:09 user nova-compute[72954]:       </enum>
Sep 04 23:25:09 user nova-compute[72954]:     </tpm>
Sep 04 23:25:09 user nova-compute[72954]:   </devices>
Sep 04 23:25:09 user nova-compute[72954]:   <features>
Sep 04 23:25:09 user nova-compute[72954]:     <gic supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:     <vmcoreinfo supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <genid supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backingStoreInput supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <backup supported='yes'/>
Sep 04 23:25:09 user nova-compute[72954]:     <sev supported='no'/>
Sep 04 23:25:09 user nova-compute[72954]:   </features>
Sep 04 23:25:09 user nova-compute[72954]: </domainCapabilities>
Sep 04 23:25:09 user nova-compute[72954]:  {{(pid=72954) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72954) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72954) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Checking secure boot support for host arch (x86_64) {{(pid=72954) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Secure Boot support detected
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] cpu compare xml: <cpu match="exact">
Sep 04 23:25:09 user nova-compute[72954]:   <model>Nehalem</model>
Sep 04 23:25:09 user nova-compute[72954]: </cpu>
Sep 04 23:25:09 user nova-compute[72954]:  {{(pid=72954) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.virt.node [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Generated node identity 1011a3ca-a5c6-4712-8224-4088238dab96
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.virt.node [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Wrote node identity 1011a3ca-a5c6-4712-8224-4088238dab96 to /opt/stack/data/nova/compute_id
Sep 04 23:25:09 user nova-compute[72954]: WARNING nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Compute nodes ['1011a3ca-a5c6-4712-8224-4088238dab96'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Sep 04 23:25:09 user nova-compute[72954]: WARNING nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Sep 04 23:25:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:25:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:25:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Hypervisor/Node resource view: name=user free_ram=10895MB free_disk=26.199405670166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:25:09 user nova-compute[72954]: WARNING nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] No compute node record for user:1011a3ca-a5c6-4712-8224-4088238dab96: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1011a3ca-a5c6-4712-8224-4088238dab96 could not be found.
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Compute node record created for user:user with uuid: 1011a3ca-a5c6-4712-8224-4088238dab96
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [req-7f8ad110-6fa2-49da-a788-103d976ea0c1] Created resource provider record via placement API for resource provider with UUID 1011a3ca-a5c6-4712-8224-4088238dab96 and name user.
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72954) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Sep 04 23:25:09 user nova-compute[72954]: INFO nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] kernel doesn't support AMD SEV
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Libvirt baseline CPU <cpu>
Sep 04 23:25:09 user nova-compute[72954]:   <arch>x86_64</arch>
Sep 04 23:25:09 user nova-compute[72954]:   <model>Nehalem</model>
Sep 04 23:25:09 user nova-compute[72954]:   <vendor>Intel</vendor>
Sep 04 23:25:09 user nova-compute[72954]:   <topology sockets="6" cores="1" threads="1"/>
Sep 04 23:25:09 user nova-compute[72954]: </cpu>
Sep 04 23:25:09 user nova-compute[72954]:  {{(pid=72954) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Updated inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Updating resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 generation from 0 to 1 during operation: update_inventory {{(pid=72954) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Sep 04 23:25:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Updating resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 generation from 1 to 2 during operation: update_traits {{(pid=72954) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG nova.service [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Creating RPC server for service compute {{(pid=72954) start /opt/stack/nova/nova/service.py:182}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG nova.service [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Join ServiceGroup membership for this service compute {{(pid=72954) start /opt/stack/nova/nova/service.py:199}}
Sep 04 23:25:10 user nova-compute[72954]: DEBUG nova.servicegroup.drivers.db [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72954) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Sep 04 23:25:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:25:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:26:00 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:26:01 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:26:01 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=10251MB free_disk=26.10312271118164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:26:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:27:02 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:27:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:27:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=10173MB free_disk=26.149185180664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:27:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:28:02 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:28:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:28:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=10151MB free_disk=25.93384552001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:28:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:28:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:02 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:29:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=9457MB free_disk=25.956256866455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:29:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:29:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:05 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:05 user nova-compute[72954]: INFO nova.compute.claims [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Claim successful on node user
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:06 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:06 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Creating image(s)
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG nova.policy [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84a77f46b55f4de2aac8145636dda0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8caf44b9944100837bfc22addb20d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG nova.virt.images [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] 6cb1e7a9-0dda-46ae-bceb-c45fe69ede15 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.part /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:07 user nova-compute[72954]: INFO nova.compute.claims [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Claim successful on node user
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.part /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.converted" returned: 0 in 0.360s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.681s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:08 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkucfrlae/privsep.sock']
Sep 04 23:29:08 user sudo[82401]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkucfrlae/privsep.sock
Sep 04 23:29:08 user sudo[82401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Successfully created port: 11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Creating image(s)
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:08 user nova-compute[72954]: DEBUG nova.policy [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84a77f46b55f4de2aac8145636dda0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8caf44b9944100837bfc22addb20d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:09 user sudo[82401]: pam_unix(sudo:session): session closed for user root
Sep 04 23:29:09 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Spawned new privsep daemon via rootwrap
Sep 04 23:29:09 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 04 23:29:09 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 04 23:29:09 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 04 23:29:09 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82404
Sep 04 23:29:09 user nova-compute[72954]: WARNING oslo_privsep.priv_context [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] privsep daemon already running
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.171s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk 1073741824" returned: 0 in 0.042s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.235s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Successfully created port: 2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk 1073741824" returned: 0 in 0.051s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Cannot resize image /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Ensure instance console log exists: /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Cannot resize image /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Ensure instance console log exists: /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:11 user nova-compute[72954]: INFO nova.compute.claims [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Claim successful on node user
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:11 user nova-compute[72954]: INFO nova.compute.claims [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Claim successful on node user
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Creating image(s)
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "/opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Successfully updated port: 11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.169s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.policy [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90f45a06454ddaa392e6cbfe58eeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4c625d90e54690b8cbb9d0c4cd6e54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk 1073741824" returned: 0 in 0.063s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Creating image(s)
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.policy [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8355bdcc8c74030b0e977319cda578a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de27ffc89c94fce98e145aeab3b1876', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-changed-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Refreshing instance network info cache due to event network-changed-11b998d2-ca1a-47a1-8b34-3b23dc55a938. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.166s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Cannot resize image /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Ensure instance console log exists: /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.169s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk 1073741824" returned: 0 in 0.040s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Cannot resize image /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Ensure instance console log exists: /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Successfully updated port: 2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance network_info: |[{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.neutron [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Refreshing network info cache for port 11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start _get_guest_xml network_info=[{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:13 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:13 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-971205064',display_name='tempest-ServerRescueNegativeTestJSON-server-971205064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-971205064',id=1,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-eaz8vxab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:07Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=09afe965-5ce9-43b6-83f7-f0e378ef33e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:13 user nova-compute[72954]:   <uuid>09afe965-5ce9-43b6-83f7-f0e378ef33e9</uuid>
Sep 04 23:29:13 user nova-compute[72954]:   <name>instance-00000001</name>
Sep 04 23:29:13 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:13 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:13 user nova-compute[72954]:   <metadata>
Sep 04 23:29:13 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:13 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-971205064</nova:name>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:13</nova:creationTime>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:13 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:13 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:29:13 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:13 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:13 user nova-compute[72954]:         <nova:port uuid="11b998d2-ca1a-47a1-8b34-3b23dc55a938">
Sep 04 23:29:13 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 04 23:29:13 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:13 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:13 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:13 user nova-compute[72954]:   </metadata>
Sep 04 23:29:13 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:13 user nova-compute[72954]:     <system>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="serial">09afe965-5ce9-43b6-83f7-f0e378ef33e9</entry>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="uuid">09afe965-5ce9-43b6-83f7-f0e378ef33e9</entry>
Sep 04 23:29:13 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:13 user nova-compute[72954]:     </system>
Sep 04 23:29:13 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:13 user nova-compute[72954]:   <os>
Sep 04 23:29:13 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:13 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:13 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:13 user nova-compute[72954]:   </os>
Sep 04 23:29:13 user nova-compute[72954]:   <features>
Sep 04 23:29:13 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:13 user nova-compute[72954]:     <apic/>
Sep 04 23:29:13 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:13 user nova-compute[72954]:   </features>
Sep 04 23:29:13 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:13 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:13 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:13 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:13 user nova-compute[72954]:   </clock>
Sep 04 23:29:13 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:13 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:13 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:13 user nova-compute[72954]:   </cpu>
Sep 04 23:29:13 user nova-compute[72954]:   <devices>
Sep 04 23:29:13 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:13 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:13 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk"/>
Sep 04 23:29:13 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:13 user nova-compute[72954]:     </disk>
Sep 04 23:29:13 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:13 user nova-compute[72954]:       <mac address="fa:16:3e:19:68:33"/>
Sep 04 23:29:13 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:13 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:13 user nova-compute[72954]:       <target dev="tap11b998d2-ca"/>
Sep 04 23:29:13 user nova-compute[72954]:     </interface>
Sep 04 23:29:13 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:13 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/console.log" append="off"/>
Sep 04 23:29:13 user nova-compute[72954]:     </serial>
Sep 04 23:29:13 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:13 user nova-compute[72954]:     <video>
Sep 04 23:29:13 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:13 user nova-compute[72954]:     </video>
Sep 04 23:29:13 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:13 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:13 user nova-compute[72954]:     </rng>
Sep 04 23:29:13 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:13 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:13 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:13 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:13 user nova-compute[72954]:   </devices>
Sep 04 23:29:13 user nova-compute[72954]: </domain>
Sep 04 23:29:13 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-971205064',display_name='tempest-ServerRescueNegativeTestJSON-server-971205064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-971205064',id=1,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-eaz8vxab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:07Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=09afe965-5ce9-43b6-83f7-f0e378ef33e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG os_vif [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Created schema index Interface.name {{(pid=72954) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Created schema index Port.name {{(pid=72954) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Created schema index Bridge.name {{(pid=72954) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [POLLOUT] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:14 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpgclt96eb/privsep.sock']
Sep 04 23:29:14 user sudo[82530]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpgclt96eb/privsep.sock
Sep 04 23:29:14 user sudo[82530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Sep 04 23:29:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-changed-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Refreshing instance network info cache due to event network-changed-2ec776aa-6f1e-46ee-b753-ae93df0a91d3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] Acquiring lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:14 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:14 user nova-compute[72954]: INFO nova.compute.claims [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Claim successful on node user
Sep 04 23:29:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Successfully created port: 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance network_info: |[{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] Acquired lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Refreshing network info cache for port 2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start _get_guest_xml network_info=[{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1384140502',display_name='tempest-ServerRescueNegativeTestJSON-server-1384140502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1384140502',id=2,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-f7i1yg3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:09Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c15ab7fd-25fc-42ba-a451-c91cfe60c884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.objects.instance [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:15 user nova-compute[72954]:   <uuid>c15ab7fd-25fc-42ba-a451-c91cfe60c884</uuid>
Sep 04 23:29:15 user nova-compute[72954]:   <name>instance-00000002</name>
Sep 04 23:29:15 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:15 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:15 user nova-compute[72954]:   <metadata>
Sep 04 23:29:15 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:15 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1384140502</nova:name>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:15</nova:creationTime>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:15 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:15 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:29:15 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:15 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:15 user nova-compute[72954]:         <nova:port uuid="2ec776aa-6f1e-46ee-b753-ae93df0a91d3">
Sep 04 23:29:15 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Sep 04 23:29:15 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:15 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:15 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:15 user nova-compute[72954]:   </metadata>
Sep 04 23:29:15 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:15 user nova-compute[72954]:     <system>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="serial">c15ab7fd-25fc-42ba-a451-c91cfe60c884</entry>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="uuid">c15ab7fd-25fc-42ba-a451-c91cfe60c884</entry>
Sep 04 23:29:15 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:15 user nova-compute[72954]:     </system>
Sep 04 23:29:15 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:15 user nova-compute[72954]:   <os>
Sep 04 23:29:15 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:15 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:15 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:15 user nova-compute[72954]:   </os>
Sep 04 23:29:15 user nova-compute[72954]:   <features>
Sep 04 23:29:15 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:15 user nova-compute[72954]:     <apic/>
Sep 04 23:29:15 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:15 user nova-compute[72954]:   </features>
Sep 04 23:29:15 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:15 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:15 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:15 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:15 user nova-compute[72954]:   </clock>
Sep 04 23:29:15 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:15 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:15 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:15 user nova-compute[72954]:   </cpu>
Sep 04 23:29:15 user nova-compute[72954]:   <devices>
Sep 04 23:29:15 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:15 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:15 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk"/>
Sep 04 23:29:15 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:15 user nova-compute[72954]:     </disk>
Sep 04 23:29:15 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:15 user nova-compute[72954]:       <mac address="fa:16:3e:4f:48:56"/>
Sep 04 23:29:15 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:15 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:15 user nova-compute[72954]:       <target dev="tap2ec776aa-6f"/>
Sep 04 23:29:15 user nova-compute[72954]:     </interface>
Sep 04 23:29:15 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:15 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/console.log" append="off"/>
Sep 04 23:29:15 user nova-compute[72954]:     </serial>
Sep 04 23:29:15 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:15 user nova-compute[72954]:     <video>
Sep 04 23:29:15 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:15 user nova-compute[72954]:     </video>
Sep 04 23:29:15 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:15 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:15 user nova-compute[72954]:     </rng>
Sep 04 23:29:15 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:15 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:15 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:15 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:15 user nova-compute[72954]:   </devices>
Sep 04 23:29:15 user nova-compute[72954]: </domain>
Sep 04 23:29:15 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1384140502',display_name='tempest-ServerRescueNegativeTestJSON-server-1384140502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1384140502',id=2,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-f7i1yg3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:09Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c15ab7fd-25fc-42ba-a451-c91cfe60c884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG os_vif [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Successfully created port: 64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Creating image(s)
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "/opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.policy [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3694a9f4359a487db80ec71c526201be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f8d4f90e74533b0f0b96581c8bd5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updated VIF entry in instance network info cache for port 11b998d2-ca1a-47a1-8b34-3b23dc55a938. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bcbd58b5-aed3-4add-b579-d396e21c532d req-4f2d35d7-a7a8-4046-ba78-cb271c407c3d service nova] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:15 user sudo[82530]: pam_unix(sudo:session): session closed for user root
Sep 04 23:29:15 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Spawned new privsep daemon via rootwrap
Sep 04 23:29:15 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 04 23:29:15 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 04 23:29:15 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Sep 04 23:29:15 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82533
Sep 04 23:29:15 user nova-compute[72954]: WARNING oslo_privsep.priv_context [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] privsep daemon already running
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.154s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk 1073741824" returned: 0 in 0.067s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Cannot resize image /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Ensure instance console log exists: /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b998d2-ca, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b998d2-ca, col_values=(('external_ids', {'iface-id': '11b998d2-ca1a-47a1-8b34-3b23dc55a938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:68:33', 'vm-uuid': '09afe965-5ce9-43b6-83f7-f0e378ef33e9'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:16 user nova-compute[72954]: INFO os_vif [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca')
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ec776aa-6f, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ec776aa-6f, col_values=(('external_ids', {'iface-id': '2ec776aa-6f1e-46ee-b753-ae93df0a91d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:48:56', 'vm-uuid': 'c15ab7fd-25fc-42ba-a451-c91cfe60c884'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:16 user nova-compute[72954]: INFO os_vif [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f')
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:19:68:33, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:4f:48:56, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updated VIF entry in instance network info cache for port 2ec776aa-6f1e-46ee-b753-ae93df0a91d3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e06301-08f5-4ea7-9fbf-d9fd3d86dd87 req-ce21a916-f7a0-4fc2-98c7-3d2dfce79625 service nova] Releasing lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Successfully updated port: 64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-changed-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Refreshing instance network info cache due to event network-changed-64e91e7a-48a2-47ca-aed2-6993b652e5f3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] Acquiring lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Successfully updated port: 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Instance network_info: |[{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] Acquired lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Refreshing network info cache for port 64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Start _get_guest_xml network_info=[{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232196010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232196010',id=3,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-847202ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:12Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=b74564bb-948a-43be-81b7-8504f4dc023a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'pci_devices' on Instance uuid b74564bb-948a-43be-81b7-8504f4dc023a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:18 user nova-compute[72954]:   <uuid>b74564bb-948a-43be-81b7-8504f4dc023a</uuid>
Sep 04 23:29:18 user nova-compute[72954]:   <name>instance-00000003</name>
Sep 04 23:29:18 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:18 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:18 user nova-compute[72954]:   <metadata>
Sep 04 23:29:18 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:18 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1232196010</nova:name>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:18</nova:creationTime>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:18 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:18 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:user uuid="9f90f45a06454ddaa392e6cbfe58eeca">tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member</nova:user>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:project uuid="cf4c625d90e54690b8cbb9d0c4cd6e54">tempest-ServerBootFromVolumeStableRescueTest-974522082</nova:project>
Sep 04 23:29:18 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:18 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:18 user nova-compute[72954]:         <nova:port uuid="64e91e7a-48a2-47ca-aed2-6993b652e5f3">
Sep 04 23:29:18 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Sep 04 23:29:18 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:18 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:18 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:18 user nova-compute[72954]:   </metadata>
Sep 04 23:29:18 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:18 user nova-compute[72954]:     <system>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="serial">b74564bb-948a-43be-81b7-8504f4dc023a</entry>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="uuid">b74564bb-948a-43be-81b7-8504f4dc023a</entry>
Sep 04 23:29:18 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:18 user nova-compute[72954]:     </system>
Sep 04 23:29:18 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:18 user nova-compute[72954]:   <os>
Sep 04 23:29:18 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:18 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:18 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:18 user nova-compute[72954]:   </os>
Sep 04 23:29:18 user nova-compute[72954]:   <features>
Sep 04 23:29:18 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:18 user nova-compute[72954]:     <apic/>
Sep 04 23:29:18 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:18 user nova-compute[72954]:   </features>
Sep 04 23:29:18 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:18 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:18 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:18 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:18 user nova-compute[72954]:   </clock>
Sep 04 23:29:18 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:18 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:18 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:18 user nova-compute[72954]:   </cpu>
Sep 04 23:29:18 user nova-compute[72954]:   <devices>
Sep 04 23:29:18 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:18 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:18 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk"/>
Sep 04 23:29:18 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:18 user nova-compute[72954]:     </disk>
Sep 04 23:29:18 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:18 user nova-compute[72954]:       <mac address="fa:16:3e:a4:97:4d"/>
Sep 04 23:29:18 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:18 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:18 user nova-compute[72954]:       <target dev="tap64e91e7a-48"/>
Sep 04 23:29:18 user nova-compute[72954]:     </interface>
Sep 04 23:29:18 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:18 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/console.log" append="off"/>
Sep 04 23:29:18 user nova-compute[72954]:     </serial>
Sep 04 23:29:18 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:18 user nova-compute[72954]:     <video>
Sep 04 23:29:18 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:18 user nova-compute[72954]:     </video>
Sep 04 23:29:18 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:18 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:18 user nova-compute[72954]:     </rng>
Sep 04 23:29:18 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:18 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:18 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:18 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:18 user nova-compute[72954]:   </devices>
Sep 04 23:29:18 user nova-compute[72954]: </domain>
Sep 04 23:29:18 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232196010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232196010',id=3,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-847202ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:12Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=b74564bb-948a-43be-81b7-8504f4dc023a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG os_vif [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64e91e7a-48, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64e91e7a-48, col_values=(('external_ids', {'iface-id': '64e91e7a-48a2-47ca-aed2-6993b652e5f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:97:4d', 'vm-uuid': 'b74564bb-948a-43be-81b7-8504f4dc023a'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Successfully created port: cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-changed-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing instance network info cache due to event network-changed-751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:18 user nova-compute[72954]: INFO os_vif [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48')
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No VIF found with MAC fa:16:3e:a4:97:4d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updated VIF entry in instance network info cache for port 64e91e7a-48a2-47ca-aed2-6993b652e5f3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-35fe2a33-643e-4829-a2bd-b51f6daaddf3 req-1dfc8517-82c4-4a87-989b-dc049988d74c service nova] Releasing lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance network_info: |[{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing network info cache for port 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start _get_guest_xml network_info=[{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:19 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:19 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1657404968',display_name='tempest-ServerStableDeviceRescueTest-server-1657404968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1657404968',id=4,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZgh255y/+LXAELpJV7eNBqpVnkHZDK1yywzwTsQ38F6MTWggrZ2S8iEHRQkGkIK43aM6t1SJqJQ3wOSWNVZ/R24frsfkYYdaBGggVzktpIfj2sOEhO9E+pt1BZRxKg0A==',key_name='tempest-keypair-121536044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de27ffc89c94fce98e145aeab3b1876',ramdisk_id='',reservation_id='r-ll2hgmty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-572734187',owner_user_name='tempest-ServerStableDeviceRescueTest-572734187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8355bdcc8c74030b0e977319cda578a',uuid=de97c8d3-65e0-4770-bf2b-44d58b5e403e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converting VIF {"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'pci_devices' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:19 user nova-compute[72954]:   <uuid>de97c8d3-65e0-4770-bf2b-44d58b5e403e</uuid>
Sep 04 23:29:19 user nova-compute[72954]:   <name>instance-00000004</name>
Sep 04 23:29:19 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:19 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:19 user nova-compute[72954]:   <metadata>
Sep 04 23:29:19 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:19 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1657404968</nova:name>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:19</nova:creationTime>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:19 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:19 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:user uuid="f8355bdcc8c74030b0e977319cda578a">tempest-ServerStableDeviceRescueTest-572734187-project-member</nova:user>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:project uuid="9de27ffc89c94fce98e145aeab3b1876">tempest-ServerStableDeviceRescueTest-572734187</nova:project>
Sep 04 23:29:19 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:19 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:19 user nova-compute[72954]:         <nova:port uuid="751176c8-9875-4a16-9f95-f0391238238b">
Sep 04 23:29:19 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:29:19 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:19 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:19 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:19 user nova-compute[72954]:   </metadata>
Sep 04 23:29:19 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:19 user nova-compute[72954]:     <system>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="serial">de97c8d3-65e0-4770-bf2b-44d58b5e403e</entry>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="uuid">de97c8d3-65e0-4770-bf2b-44d58b5e403e</entry>
Sep 04 23:29:19 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:19 user nova-compute[72954]:     </system>
Sep 04 23:29:19 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:19 user nova-compute[72954]:   <os>
Sep 04 23:29:19 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:19 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:19 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:19 user nova-compute[72954]:   </os>
Sep 04 23:29:19 user nova-compute[72954]:   <features>
Sep 04 23:29:19 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:19 user nova-compute[72954]:     <apic/>
Sep 04 23:29:19 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:19 user nova-compute[72954]:   </features>
Sep 04 23:29:19 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:19 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:19 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:19 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:19 user nova-compute[72954]:   </clock>
Sep 04 23:29:19 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:19 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:19 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:19 user nova-compute[72954]:   </cpu>
Sep 04 23:29:19 user nova-compute[72954]:   <devices>
Sep 04 23:29:19 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:19 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:19 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk"/>
Sep 04 23:29:19 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:19 user nova-compute[72954]:     </disk>
Sep 04 23:29:19 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:19 user nova-compute[72954]:       <mac address="fa:16:3e:26:d9:48"/>
Sep 04 23:29:19 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:19 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:19 user nova-compute[72954]:       <target dev="tap751176c8-98"/>
Sep 04 23:29:19 user nova-compute[72954]:     </interface>
Sep 04 23:29:19 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:19 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/console.log" append="off"/>
Sep 04 23:29:19 user nova-compute[72954]:     </serial>
Sep 04 23:29:19 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:19 user nova-compute[72954]:     <video>
Sep 04 23:29:19 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:19 user nova-compute[72954]:     </video>
Sep 04 23:29:19 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:19 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:19 user nova-compute[72954]:     </rng>
Sep 04 23:29:19 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:19 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:19 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:19 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:19 user nova-compute[72954]:   </devices>
Sep 04 23:29:19 user nova-compute[72954]: </domain>
Sep 04 23:29:19 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1657404968',display_name='tempest-ServerStableDeviceRescueTest-server-1657404968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1657404968',id=4,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZgh255y/+LXAELpJV7eNBqpVnkHZDK1yywzwTsQ38F6MTWggrZ2S8iEHRQkGkIK43aM6t1SJqJQ3wOSWNVZ/R24frsfkYYdaBGggVzktpIfj2sOEhO9E+pt1BZRxKg0A==',key_name='tempest-keypair-121536044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9de27ffc89c94fce98e145aeab3b1876',ramdisk_id='',reservation_id='r-ll2hgmty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-572734187',owner_user_name='tempest-ServerStableDeviceRescueTest-572734187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8355bdcc8c74030b0e977319cda578a',uuid=de97c8d3-65e0-4770-bf2b-44d58b5e403e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converting VIF {"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG os_vif [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap751176c8-98, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap751176c8-98, col_values=(('external_ids', {'iface-id': '751176c8-9875-4a16-9f95-f0391238238b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:d9:48', 'vm-uuid': 'de97c8d3-65e0-4770-bf2b-44d58b5e403e'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:19 user nova-compute[72954]: INFO os_vif [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98')
Sep 04 23:29:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No VIF found with MAC fa:16:3e:26:d9:48, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updated VIF entry in instance network info cache for port 751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352cbe54-b975-49ae-9c46-9b51385e6fe2 req-dfa94c0b-092c-4ff2-8ce1-4773d1a7e82d service nova] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Successfully updated port: cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-changed-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing instance network info cache due to event network-changed-cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870163.50261, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Resumed (Lifecycle Event)
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance spawned successfully.
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870163.5145965, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Started (Lifecycle Event)
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Took 17.13 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:23 user nova-compute[72954]: INFO nova.compute.manager [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Took 18.23 seconds to build instance.
Sep 04 23:29:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a346541-934b-4468-94f7-6eae39b8551f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.475s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Instance network_info: |[{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing network info cache for port cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Start _get_guest_xml network_info=[{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1700502807',display_name='tempest-ServerActionsTestOtherA-server-1700502807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1700502807',id=5,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-bams1gld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=d57a3389-b5ab-4dc3-8729-6e87085a4e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.objects.instance [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'pci_devices' on Instance uuid d57a3389-b5ab-4dc3-8729-6e87085a4e54 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:24 user nova-compute[72954]:   <uuid>d57a3389-b5ab-4dc3-8729-6e87085a4e54</uuid>
Sep 04 23:29:24 user nova-compute[72954]:   <name>instance-00000005</name>
Sep 04 23:29:24 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:24 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:24 user nova-compute[72954]:   <metadata>
Sep 04 23:29:24 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:24 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherA-server-1700502807</nova:name>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:24</nova:creationTime>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:24 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:24 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:user uuid="3694a9f4359a487db80ec71c526201be">tempest-ServerActionsTestOtherA-520106611-project-member</nova:user>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:project uuid="9c2f8d4f90e74533b0f0b96581c8bd5a">tempest-ServerActionsTestOtherA-520106611</nova:project>
Sep 04 23:29:24 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:24 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:24 user nova-compute[72954]:         <nova:port uuid="cbea434f-2c70-48bf-a272-430d03d91514">
Sep 04 23:29:24 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 04 23:29:24 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:24 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:24 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:24 user nova-compute[72954]:   </metadata>
Sep 04 23:29:24 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:24 user nova-compute[72954]:     <system>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="serial">d57a3389-b5ab-4dc3-8729-6e87085a4e54</entry>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="uuid">d57a3389-b5ab-4dc3-8729-6e87085a4e54</entry>
Sep 04 23:29:24 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:24 user nova-compute[72954]:     </system>
Sep 04 23:29:24 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:24 user nova-compute[72954]:   <os>
Sep 04 23:29:24 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:24 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:24 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:24 user nova-compute[72954]:   </os>
Sep 04 23:29:24 user nova-compute[72954]:   <features>
Sep 04 23:29:24 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:24 user nova-compute[72954]:     <apic/>
Sep 04 23:29:24 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:24 user nova-compute[72954]:   </features>
Sep 04 23:29:24 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:24 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:24 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:24 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:24 user nova-compute[72954]:   </clock>
Sep 04 23:29:24 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:24 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:24 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:24 user nova-compute[72954]:   </cpu>
Sep 04 23:29:24 user nova-compute[72954]:   <devices>
Sep 04 23:29:24 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:24 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:24 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk"/>
Sep 04 23:29:24 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:24 user nova-compute[72954]:     </disk>
Sep 04 23:29:24 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:24 user nova-compute[72954]:       <mac address="fa:16:3e:44:15:44"/>
Sep 04 23:29:24 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:24 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:24 user nova-compute[72954]:       <target dev="tapcbea434f-2c"/>
Sep 04 23:29:24 user nova-compute[72954]:     </interface>
Sep 04 23:29:24 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:24 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/console.log" append="off"/>
Sep 04 23:29:24 user nova-compute[72954]:     </serial>
Sep 04 23:29:24 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:24 user nova-compute[72954]:     <video>
Sep 04 23:29:24 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:24 user nova-compute[72954]:     </video>
Sep 04 23:29:24 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:24 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:24 user nova-compute[72954]:     </rng>
Sep 04 23:29:24 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:24 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:24 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:24 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:24 user nova-compute[72954]:   </devices>
Sep 04 23:29:24 user nova-compute[72954]: </domain>
Sep 04 23:29:24 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1700502807',display_name='tempest-ServerActionsTestOtherA-server-1700502807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1700502807',id=5,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-bams1gld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=d57a3389-b5ab-4dc3-8729-6e87085a4e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG os_vif [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbea434f-2c, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbea434f-2c, col_values=(('external_ids', {'iface-id': 'cbea434f-2c70-48bf-a272-430d03d91514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:15:44', 'vm-uuid': 'd57a3389-b5ab-4dc3-8729-6e87085a4e54'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:24 user nova-compute[72954]: INFO os_vif [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c')
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:44:15:44, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated VIF entry in instance network info cache for port cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a576372-19cf-4940-b767-97392bb13db5 req-548b76ab-95db-4a6b-9937-d8e7ebb0cffc service nova] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.0177617, c15ab7fd-25fc-42ba-a451-c91cfe60c884 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] VM Resumed (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance spawned successfully.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.038516, c15ab7fd-25fc-42ba-a451-c91cfe60c884 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] VM Started (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Instance spawned successfully.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance spawned successfully.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.1906517, b74564bb-948a-43be-81b7-8504f4dc023a => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] VM Resumed (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Took 17.71 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Took 14.51 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.1961257, b74564bb-948a-43be-81b7-8504f4dc023a => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] VM Started (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.242528, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Resumed (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Took 15.39 seconds to build instance.
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Took 14.21 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Took 18.84 seconds to build instance.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5fe62e33-b79d-4af2-b62d-dd5fe710a216 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.563s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07fdfa39-c75d-4759-a665-aac5a3d80bc5 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.067s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870166.2450216, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Started (Lifecycle Event)
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:27 user nova-compute[72954]: INFO nova.compute.manager [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Took 15.55 seconds to build instance.
Sep 04 23:29:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dc2c614f-0334-4aa0-a5b2-1789e0187262 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.725s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870169.5898962, d57a3389-b5ab-4dc3-8729-6e87085a4e54 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] VM Resumed (Lifecycle Event)
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Instance spawned successfully.
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870169.5930097, d57a3389-b5ab-4dc3-8729-6e87085a4e54 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] VM Started (Lifecycle Event)
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:30 user nova-compute[72954]: INFO nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Took 14.43 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:30 user nova-compute[72954]: INFO nova.compute.claims [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Claim successful on node user
Sep 04 23:29:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:30 user nova-compute[72954]: INFO nova.compute.manager [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Took 15.68 seconds to build instance.
Sep 04 23:29:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23c5fc04-100f-4653-adbc-6a6c8a020457 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.845s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:30 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.951s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Creating image(s)
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "/opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "/opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "/opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG nova.policy [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b7def3475ff4df1a6ce5664ecbe33cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa30aac7532d4178be510b5f39c3211c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.425s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.330s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk 1073741824" returned: 0 in 0.071s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.412s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.344s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Cannot resize image /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Ensure instance console log exists: /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Successfully created port: e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Successfully updated port: e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquired lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-changed-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Refreshing instance network info cache due to event network-changed-e25d703b-4dcd-4550-87c9-c254515dcacf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] Acquiring lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating instance_info_cache with network_info: [{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Releasing lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Instance network_info: |[{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] Acquired lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.neutron [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Refreshing network info cache for port e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Start _get_guest_xml network_info=[{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:36 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:36 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1416911431',display_name='tempest-VolumesAdminNegativeTest-server-1416911431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1416911431',id=6,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9ecI2QEaJZVk8IBkRJVO3rGpQD8Nd4kYyFwGkzm/YDckojLLNaiAEtoVFoNyZBglJujL2nSRGHlrkZRz5P8TDD5Af0G5wtIM+qI85BVqKtXNksSGI/BYjfV170dKYQTg==',key_name='tempest-keypair-1488180374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-law4a72m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=625f0d50-b25e-4542-863a-a65a8be8148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.objects.instance [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'pci_devices' on Instance uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:36 user nova-compute[72954]:   <uuid>625f0d50-b25e-4542-863a-a65a8be8148d</uuid>
Sep 04 23:29:36 user nova-compute[72954]:   <name>instance-00000006</name>
Sep 04 23:29:36 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:36 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:36 user nova-compute[72954]:   <metadata>
Sep 04 23:29:36 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:36 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1416911431</nova:name>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:36</nova:creationTime>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:36 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:36 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:user uuid="9b7def3475ff4df1a6ce5664ecbe33cd">tempest-VolumesAdminNegativeTest-647256197-project-member</nova:user>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:project uuid="fa30aac7532d4178be510b5f39c3211c">tempest-VolumesAdminNegativeTest-647256197</nova:project>
Sep 04 23:29:36 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:36 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:36 user nova-compute[72954]:         <nova:port uuid="e25d703b-4dcd-4550-87c9-c254515dcacf">
Sep 04 23:29:36 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Sep 04 23:29:36 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:36 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:36 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:36 user nova-compute[72954]:   </metadata>
Sep 04 23:29:36 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:36 user nova-compute[72954]:     <system>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="serial">625f0d50-b25e-4542-863a-a65a8be8148d</entry>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="uuid">625f0d50-b25e-4542-863a-a65a8be8148d</entry>
Sep 04 23:29:36 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:36 user nova-compute[72954]:     </system>
Sep 04 23:29:36 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:36 user nova-compute[72954]:   <os>
Sep 04 23:29:36 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:36 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:36 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:36 user nova-compute[72954]:   </os>
Sep 04 23:29:36 user nova-compute[72954]:   <features>
Sep 04 23:29:36 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:36 user nova-compute[72954]:     <apic/>
Sep 04 23:29:36 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:36 user nova-compute[72954]:   </features>
Sep 04 23:29:36 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:36 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:36 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:36 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:36 user nova-compute[72954]:   </clock>
Sep 04 23:29:36 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:36 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:36 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:36 user nova-compute[72954]:   </cpu>
Sep 04 23:29:36 user nova-compute[72954]:   <devices>
Sep 04 23:29:36 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:36 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:36 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk"/>
Sep 04 23:29:36 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:36 user nova-compute[72954]:     </disk>
Sep 04 23:29:36 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:36 user nova-compute[72954]:       <mac address="fa:16:3e:4e:93:05"/>
Sep 04 23:29:36 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:36 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:36 user nova-compute[72954]:       <target dev="tape25d703b-4d"/>
Sep 04 23:29:36 user nova-compute[72954]:     </interface>
Sep 04 23:29:36 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:36 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/console.log" append="off"/>
Sep 04 23:29:36 user nova-compute[72954]:     </serial>
Sep 04 23:29:36 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:36 user nova-compute[72954]:     <video>
Sep 04 23:29:36 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:36 user nova-compute[72954]:     </video>
Sep 04 23:29:36 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:36 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:36 user nova-compute[72954]:     </rng>
Sep 04 23:29:36 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:36 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:36 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:36 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:36 user nova-compute[72954]:   </devices>
Sep 04 23:29:36 user nova-compute[72954]: </domain>
Sep 04 23:29:36 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1416911431',display_name='tempest-VolumesAdminNegativeTest-server-1416911431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1416911431',id=6,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9ecI2QEaJZVk8IBkRJVO3rGpQD8Nd4kYyFwGkzm/YDckojLLNaiAEtoVFoNyZBglJujL2nSRGHlrkZRz5P8TDD5Af0G5wtIM+qI85BVqKtXNksSGI/BYjfV170dKYQTg==',key_name='tempest-keypair-1488180374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-law4a72m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=625f0d50-b25e-4542-863a-a65a8be8148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG os_vif [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape25d703b-4d, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape25d703b-4d, col_values=(('external_ids', {'iface-id': 'e25d703b-4dcd-4550-87c9-c254515dcacf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:93:05', 'vm-uuid': '625f0d50-b25e-4542-863a-a65a8be8148d'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:36 user nova-compute[72954]: INFO os_vif [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d')
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No VIF found with MAC fa:16:3e:4e:93:05, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updated VIF entry in instance network info cache for port e25d703b-4dcd-4550-87c9-c254515dcacf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating instance_info_cache with network_info: [{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ab0522bd-a781-41a3-b145-2bfbfd0e9c3d req-69ce79b4-c494-4ed7-8544-d96ace8c2610 service nova] Releasing lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:41 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870181.9109776, 625f0d50-b25e-4542-863a-a65a8be8148d => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] VM Resumed (Lifecycle Event)
Sep 04 23:29:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:41 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Instance spawned successfully.
Sep 04 23:29:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870181.9246898, 625f0d50-b25e-4542-863a-a65a8be8148d => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] VM Started (Lifecycle Event)
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:42 user nova-compute[72954]: INFO nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Took 10.63 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:42 user nova-compute[72954]: INFO nova.compute.manager [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Took 12.41 seconds to build instance.
Sep 04 23:29:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6f02541f-3114-4489-99b6-1c3dca56ab7d tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.829s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:43 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:43 user nova-compute[72954]: INFO nova.compute.claims [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Claim successful on node user
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:44 user nova-compute[72954]: WARNING nova.compute.manager [req-a8aded88-26a3-450e-b337-76ab551ce7ae req-743f8af2-b30a-455e-a836-c705755a41de service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state None.
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] No waiting events found dispatching network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:44 user nova-compute[72954]: WARNING nova.compute.manager [req-1f33a29e-4fce-44e4-bed6-9b85921aff17 req-d7ddcc0b-dba4-4453-ba9e-dd4485b38d83 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received unexpected event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf for instance with vm_state active and task_state None.
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.940s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:44 user nova-compute[72954]: DEBUG nova.policy [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '050fb22bcc8d4fdf99e1857e1d232cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3334f294cb3444ca934331e740d20ea3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:45 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Creating image(s)
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "/opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "/opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.240s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk 1073741824" returned: 0 in 0.061s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Cannot resize image /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Ensure instance console log exists: /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:46 user nova-compute[72954]: WARNING nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state None.
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:46 user nova-compute[72954]: WARNING nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state None.
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:46 user nova-compute[72954]: WARNING nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state None.
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] No waiting events found dispatching network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:46 user nova-compute[72954]: WARNING nova.compute.manager [req-f84a9dcd-b56f-4588-8997-dfd5a802340e req-8637a13c-f870-48d3-82a5-a5b89da4b99e service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received unexpected event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 for instance with vm_state active and task_state None.
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Successfully created port: ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] No waiting events found dispatching network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:46 user nova-compute[72954]: WARNING nova.compute.manager [req-10b25694-3b79-480e-a410-9fd50637fd31 req-ce97d2cd-063d-4618-a4b6-714e961062bb service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received unexpected event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf for instance with vm_state active and task_state None.
Sep 04 23:29:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:47 user nova-compute[72954]: INFO nova.compute.claims [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Claim successful on node user
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Successfully updated port: ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.265s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquired lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:48 user nova-compute[72954]: INFO nova.compute.claims [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Claim successful on node user
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] No waiting events found dispatching network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:48 user nova-compute[72954]: WARNING nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received unexpected event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 for instance with vm_state active and task_state None.
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] No waiting events found dispatching network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:48 user nova-compute[72954]: WARNING nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received unexpected event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 for instance with vm_state active and task_state None.
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-changed-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Refreshing instance network info cache due to event network-changed-ae69a72e-e5a1-4294-ab47-343a59702ee3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Acquiring lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Creating image(s)
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:48 user nova-compute[72954]: DEBUG nova.policy [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e00d4f84f374ca481c2c48c0f108494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9fea4a71daa4dc09370352ed256652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.part --force-share --output=json" returned: 0 in 0.251s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.images [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] 5b4a1f56-870d-4e5a-b979-324451e46016 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.part /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updating instance_info_cache with network_info: [{"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Releasing lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Instance network_info: |[{"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Acquired lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Refreshing network info cache for port ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Start _get_guest_xml network_info=[{"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.400s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:49 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:49 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1088114313',display_name='tempest-TestVolumeSwap-server-1088114313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1088114313',id=7,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLagqR3MgukgSt69vNRIhsCMWjRQ6aWCAUl8aNOjwEbd0qowwbzpSEx/ECnd/dvGfCeAYn4pePff86iLmUu4GEEHPApbjtxHn6TqEo0ZqYnON2E1IVfR7r2zvz1kf+NfFg==',key_name='tempest-keypair-99913944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3334f294cb3444ca934331e740d20ea3',ramdisk_id='',reservation_id='r-3c5uvq0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1259080742',owner_user_name='tempest-TestVolumeSwap-1259080742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='050fb22bcc8d4fdf99e1857e1d232cac',uuid=e4b9dde7-133f-4f2a-b2e4-6cdafb61db98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converting VIF {"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lazy-loading 'pci_devices' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.part /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.converted" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:49 user nova-compute[72954]:   <uuid>e4b9dde7-133f-4f2a-b2e4-6cdafb61db98</uuid>
Sep 04 23:29:49 user nova-compute[72954]:   <name>instance-00000007</name>
Sep 04 23:29:49 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:49 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:49 user nova-compute[72954]:   <metadata>
Sep 04 23:29:49 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:49 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:name>tempest-TestVolumeSwap-server-1088114313</nova:name>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:49</nova:creationTime>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:49 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:49 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:user uuid="050fb22bcc8d4fdf99e1857e1d232cac">tempest-TestVolumeSwap-1259080742-project-member</nova:user>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:project uuid="3334f294cb3444ca934331e740d20ea3">tempest-TestVolumeSwap-1259080742</nova:project>
Sep 04 23:29:49 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:49 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:49 user nova-compute[72954]:         <nova:port uuid="ae69a72e-e5a1-4294-ab47-343a59702ee3">
Sep 04 23:29:49 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:29:49 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:49 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:49 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:49 user nova-compute[72954]:   </metadata>
Sep 04 23:29:49 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:49 user nova-compute[72954]:     <system>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="serial">e4b9dde7-133f-4f2a-b2e4-6cdafb61db98</entry>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="uuid">e4b9dde7-133f-4f2a-b2e4-6cdafb61db98</entry>
Sep 04 23:29:49 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:49 user nova-compute[72954]:     </system>
Sep 04 23:29:49 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:49 user nova-compute[72954]:   <os>
Sep 04 23:29:49 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:49 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:49 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:49 user nova-compute[72954]:   </os>
Sep 04 23:29:49 user nova-compute[72954]:   <features>
Sep 04 23:29:49 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:49 user nova-compute[72954]:     <apic/>
Sep 04 23:29:49 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:49 user nova-compute[72954]:   </features>
Sep 04 23:29:49 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:49 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:49 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:49 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:49 user nova-compute[72954]:   </clock>
Sep 04 23:29:49 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:49 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:49 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:49 user nova-compute[72954]:   </cpu>
Sep 04 23:29:49 user nova-compute[72954]:   <devices>
Sep 04 23:29:49 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:49 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:49 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk"/>
Sep 04 23:29:49 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:49 user nova-compute[72954]:     </disk>
Sep 04 23:29:49 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:49 user nova-compute[72954]:       <mac address="fa:16:3e:80:80:b1"/>
Sep 04 23:29:49 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:49 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:49 user nova-compute[72954]:       <target dev="tapae69a72e-e5"/>
Sep 04 23:29:49 user nova-compute[72954]:     </interface>
Sep 04 23:29:49 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:49 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/console.log" append="off"/>
Sep 04 23:29:49 user nova-compute[72954]:     </serial>
Sep 04 23:29:49 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:49 user nova-compute[72954]:     <video>
Sep 04 23:29:49 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:49 user nova-compute[72954]:     </video>
Sep 04 23:29:49 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:49 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:49 user nova-compute[72954]:     </rng>
Sep 04 23:29:49 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:49 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:49 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:49 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:49 user nova-compute[72954]:   </devices>
Sep 04 23:29:49 user nova-compute[72954]: </domain>
Sep 04 23:29:49 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1088114313',display_name='tempest-TestVolumeSwap-server-1088114313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1088114313',id=7,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLagqR3MgukgSt69vNRIhsCMWjRQ6aWCAUl8aNOjwEbd0qowwbzpSEx/ECnd/dvGfCeAYn4pePff86iLmUu4GEEHPApbjtxHn6TqEo0ZqYnON2E1IVfR7r2zvz1kf+NfFg==',key_name='tempest-keypair-99913944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3334f294cb3444ca934331e740d20ea3',ramdisk_id='',reservation_id='r-3c5uvq0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1259080742',owner_user_name='tempest-TestVolumeSwap-1259080742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='050fb22bcc8d4fdf99e1857e1d232cac',uuid=e4b9dde7-133f-4f2a-b2e4-6cdafb61db98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converting VIF {"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG os_vif [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae69a72e-e5, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae69a72e-e5, col_values=(('external_ids', {'iface-id': 'ae69a72e-e5a1-4294-ab47-343a59702ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:80:b1', 'vm-uuid': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:49 user nova-compute[72954]: INFO os_vif [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5')
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.policy [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7cb888448fb4c389096c8be0e881847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed713e4a84fe4a8eb43e342c36a2f860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] No VIF found with MAC fa:16:3e:80:80:b1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.363s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Creating image(s)
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Successfully created port: d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439,backing_fmt=raw /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439,backing_fmt=raw /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk 1073741824" returned: 0 in 0.060s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "3cf8b39b91c2dcd2d076201ba3cf50de9af45439" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Successfully created port: 1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk 1073741824" returned: 0 in 0.092s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updated VIF entry in instance network info cache for port ae69a72e-e5a1-4294-ab47-343a59702ee3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updating instance_info_cache with network_info: [{"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Releasing lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] No waiting events found dispatching network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:50 user nova-compute[72954]: WARNING nova.compute.manager [req-6e1afe47-7dc9-4d42-8e67-bbdaad65c460 req-ffec35e4-d66b-45e0-beda-e845495a9c34 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received unexpected event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 for instance with vm_state active and task_state None.
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Cannot resize image /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Ensure instance console log exists: /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Successfully updated port: d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquired lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-changed-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Refreshing instance network info cache due to event network-changed-d249f205-6e80-4b22-9a2d-c9924bb04418. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] Acquiring lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Successfully updated port: 1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-changed-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing instance network info cache due to event network-changed-1d7af612-bd03-4234-b329-92603ec8e2ce. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updating instance_info_cache with network_info: [{"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Releasing lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Instance network_info: |[{"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] Acquired lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Refreshing network info cache for port d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Start _get_guest_xml network_info=[{"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:29:37Z,direct_url=<?>,disk_format='qcow2',id=5b4a1f56-870d-4e5a-b979-324451e46016,min_disk=0,min_ram=0,name='',owner='2e8a2fb9702f4caa88aedea00e4365ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:29:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '5b4a1f56-870d-4e5a-b979-324451e46016'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:29:37Z,direct_url=<?>,disk_format='qcow2',id=5b4a1f56-870d-4e5a-b979-324451e46016,min_disk=0,min_ram=0,name='',owner='2e8a2fb9702f4caa88aedea00e4365ec',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:29:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-461411492',display_name='tempest-AttachSCSIVolumeTestJSON-server-461411492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-461411492',id=8,image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDffEw5+0U+AbCbHG9LOO4aFONuM7LELbHMXskkcSWzyEZYsoVrsRs0l5XrBA2IYpVGR6O45xB89tlBXHwY1Zf8am+VV19MczRBL0/+GFXQxG5cySx9BsCS2SUamL+FDjg==',key_name='tempest-keypair-1758342468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9fea4a71daa4dc09370352ed256652a',ramdisk_id='',reservation_id='r-qx038vx9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1082228639',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1082228639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e00d4f84f374ca481c2c48c0f108494',uuid=016c702e-e3f2-416d-8faa-164bb25eabdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converting VIF {"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lazy-loading 'pci_devices' on Instance uuid 016c702e-e3f2-416d-8faa-164bb25eabdc {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:51 user nova-compute[72954]:   <uuid>016c702e-e3f2-416d-8faa-164bb25eabdc</uuid>
Sep 04 23:29:51 user nova-compute[72954]:   <name>instance-00000008</name>
Sep 04 23:29:51 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:51 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:51 user nova-compute[72954]:   <metadata>
Sep 04 23:29:51 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:51 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-461411492</nova:name>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:51</nova:creationTime>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:51 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:51 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:user uuid="8e00d4f84f374ca481c2c48c0f108494">tempest-AttachSCSIVolumeTestJSON-1082228639-project-member</nova:user>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:project uuid="d9fea4a71daa4dc09370352ed256652a">tempest-AttachSCSIVolumeTestJSON-1082228639</nova:project>
Sep 04 23:29:51 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:root type="image" uuid="5b4a1f56-870d-4e5a-b979-324451e46016"/>
Sep 04 23:29:51 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:51 user nova-compute[72954]:         <nova:port uuid="d249f205-6e80-4b22-9a2d-c9924bb04418">
Sep 04 23:29:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:29:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:51 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:51 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:51 user nova-compute[72954]:   </metadata>
Sep 04 23:29:51 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:51 user nova-compute[72954]:     <system>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="serial">016c702e-e3f2-416d-8faa-164bb25eabdc</entry>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="uuid">016c702e-e3f2-416d-8faa-164bb25eabdc</entry>
Sep 04 23:29:51 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:51 user nova-compute[72954]:     </system>
Sep 04 23:29:51 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:51 user nova-compute[72954]:   <os>
Sep 04 23:29:51 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:51 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:51 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:51 user nova-compute[72954]:   </os>
Sep 04 23:29:51 user nova-compute[72954]:   <features>
Sep 04 23:29:51 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:51 user nova-compute[72954]:     <apic/>
Sep 04 23:29:51 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:51 user nova-compute[72954]:   </features>
Sep 04 23:29:51 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:51 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:51 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:51 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:51 user nova-compute[72954]:   </clock>
Sep 04 23:29:51 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:51 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:51 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:51 user nova-compute[72954]:   </cpu>
Sep 04 23:29:51 user nova-compute[72954]:   <devices>
Sep 04 23:29:51 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:51 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:51 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk"/>
Sep 04 23:29:51 user nova-compute[72954]:       <target dev="sda" bus="scsi"/>
Sep 04 23:29:51 user nova-compute[72954]:       <address type="drive" controller="0" unit="0"/>
Sep 04 23:29:51 user nova-compute[72954]:     </disk>
Sep 04 23:29:51 user nova-compute[72954]:     <disk type="file" device="cdrom">
Sep 04 23:29:51 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none"/>
Sep 04 23:29:51 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.config"/>
Sep 04 23:29:51 user nova-compute[72954]:       <target dev="sdb" bus="scsi"/>
Sep 04 23:29:51 user nova-compute[72954]:       <address type="drive" controller="0" unit="1"/>
Sep 04 23:29:51 user nova-compute[72954]:     </disk>
Sep 04 23:29:51 user nova-compute[72954]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Sep 04 23:29:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:51 user nova-compute[72954]:       <mac address="fa:16:3e:9a:f4:6c"/>
Sep 04 23:29:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:51 user nova-compute[72954]:       <target dev="tapd249f205-6e"/>
Sep 04 23:29:51 user nova-compute[72954]:     </interface>
Sep 04 23:29:51 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:51 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/console.log" append="off"/>
Sep 04 23:29:51 user nova-compute[72954]:     </serial>
Sep 04 23:29:51 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:51 user nova-compute[72954]:     <video>
Sep 04 23:29:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:51 user nova-compute[72954]:     </video>
Sep 04 23:29:51 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:51 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:51 user nova-compute[72954]:     </rng>
Sep 04 23:29:51 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:51 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:51 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:51 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:51 user nova-compute[72954]:   </devices>
Sep 04 23:29:51 user nova-compute[72954]: </domain>
Sep 04 23:29:51 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-461411492',display_name='tempest-AttachSCSIVolumeTestJSON-server-461411492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-461411492',id=8,image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDffEw5+0U+AbCbHG9LOO4aFONuM7LELbHMXskkcSWzyEZYsoVrsRs0l5XrBA2IYpVGR6O45xB89tlBXHwY1Zf8am+VV19MczRBL0/+GFXQxG5cySx9BsCS2SUamL+FDjg==',key_name='tempest-keypair-1758342468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9fea4a71daa4dc09370352ed256652a',ramdisk_id='',reservation_id='r-qx038vx9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1082228639',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1082228639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e00d4f84f374ca481c2c48c0f108494',uuid=016c702e-e3f2-416d-8faa-164bb25eabdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converting VIF {"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG os_vif [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd249f205-6e, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd249f205-6e, col_values=(('external_ids', {'iface-id': 'd249f205-6e80-4b22-9a2d-c9924bb04418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:f4:6c', 'vm-uuid': '016c702e-e3f2-416d-8faa-164bb25eabdc'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Instance network_info: |[{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing network info cache for port 1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Start _get_guest_xml network_info=[{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:51 user nova-compute[72954]: INFO os_vif [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e')
Sep 04 23:29:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:52 user nova-compute[72954]:   <uuid>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</uuid>
Sep 04 23:29:52 user nova-compute[72954]:   <name>instance-00000009</name>
Sep 04 23:29:52 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:52 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:52 user nova-compute[72954]:   <metadata>
Sep 04 23:29:52 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:52 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:51</nova:creationTime>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:52 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:52 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:29:52 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:52 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:52 user nova-compute[72954]:         <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:29:52 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:29:52 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:52 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:52 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:52 user nova-compute[72954]:   </metadata>
Sep 04 23:29:52 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:52 user nova-compute[72954]:     <system>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="serial">6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="uuid">6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:29:52 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:52 user nova-compute[72954]:     </system>
Sep 04 23:29:52 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:52 user nova-compute[72954]:   <os>
Sep 04 23:29:52 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:52 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:52 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:52 user nova-compute[72954]:   </os>
Sep 04 23:29:52 user nova-compute[72954]:   <features>
Sep 04 23:29:52 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:52 user nova-compute[72954]:     <apic/>
Sep 04 23:29:52 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:52 user nova-compute[72954]:   </features>
Sep 04 23:29:52 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:52 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:52 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:52 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:52 user nova-compute[72954]:   </clock>
Sep 04 23:29:52 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:52 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:52 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:52 user nova-compute[72954]:   </cpu>
Sep 04 23:29:52 user nova-compute[72954]:   <devices>
Sep 04 23:29:52 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:52 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:52 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk"/>
Sep 04 23:29:52 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:52 user nova-compute[72954]:     </disk>
Sep 04 23:29:52 user nova-compute[72954]:     <disk type="file" device="cdrom">
Sep 04 23:29:52 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none"/>
Sep 04 23:29:52 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config"/>
Sep 04 23:29:52 user nova-compute[72954]:       <target dev="hda" bus="ide"/>
Sep 04 23:29:52 user nova-compute[72954]:     </disk>
Sep 04 23:29:52 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:52 user nova-compute[72954]:       <mac address="fa:16:3e:a2:3d:13"/>
Sep 04 23:29:52 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:52 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:52 user nova-compute[72954]:       <target dev="tap1d7af612-bd"/>
Sep 04 23:29:52 user nova-compute[72954]:     </interface>
Sep 04 23:29:52 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:52 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log" append="off"/>
Sep 04 23:29:52 user nova-compute[72954]:     </serial>
Sep 04 23:29:52 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:52 user nova-compute[72954]:     <video>
Sep 04 23:29:52 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:52 user nova-compute[72954]:     </video>
Sep 04 23:29:52 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:52 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:52 user nova-compute[72954]:     </rng>
Sep 04 23:29:52 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:52 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:52 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:52 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:52 user nova-compute[72954]:   </devices>
Sep 04 23:29:52 user nova-compute[72954]: </domain>
Sep 04 23:29:52 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG os_vif [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d7af612-bd, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d7af612-bd, col_values=(('external_ids', {'iface-id': '1d7af612-bd03-4234-b329-92603ec8e2ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:3d:13', 'vm-uuid': '6f2dd93c-0564-4e76-8219-a4e5a7aaace5'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:52 user nova-compute[72954]: INFO os_vif [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd')
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] No BDM found with device name sda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] No VIF found with MAC fa:16:3e:9a:f4:6c, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Using config drive
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name hda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No VIF found with MAC fa:16:3e:a2:3d:13, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Using config drive
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Creating config drive at /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.config
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2t1d69xs {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2t1d69xs" returned: 0 in 0.053s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updated VIF entry in instance network info cache for port d249f205-6e80-4b22-9a2d-c9924bb04418. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updating instance_info_cache with network_info: [{"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c25fb7f3-6e03-4939-865e-f7090026b3bc req-f3a0572e-93a2-4c9c-a082-9152c7ff810a service nova] Releasing lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Creating config drive at /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfxah6ab {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfxah6ab" returned: 0 in 0.064s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updated VIF entry in instance network info cache for port 1d7af612-bd03-4234-b329-92603ec8e2ce. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ffddc98-ac86-46cd-9f7b-4c431d95e6b5 req-b7479311-32ac-4a56-b370-0672f9042544 service nova] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:29:53 user nova-compute[72954]: INFO nova.compute.claims [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Claim successful on node user
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870194.1122904, e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] VM Resumed (Lifecycle Event)
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Instance spawned successfully.
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870194.11461, e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] VM Started (Lifecycle Event)
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:54 user nova-compute[72954]: WARNING nova.compute.manager [req-ee1e4243-cb0e-46fd-9b47-961013ba0fcd req-0ec1f405-b33b-40b3-a830-7e50309a94ff service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state None.
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Took 9.31 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.compute.manager [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Took 10.78 seconds to build instance.
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b260c3b-699f-469e-9d85-e2c9a5aa62c8 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.981s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.policy [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a882d3b4957e4419b1b6afd01063a48d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a8fa3b55ac4df2a926625cae56e5da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:29:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Creating image(s)
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "/opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "/opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.225s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk 1073741824" returned: 0 in 0.052s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Successfully created port: 81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] No waiting events found dispatching network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:55 user nova-compute[72954]: WARNING nova.compute.manager [req-6cba41a1-863a-4e1f-96ee-a7cf469c2921 req-1649518a-096c-4c6a-8497-cce56b061e81 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received unexpected event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 for instance with vm_state building and task_state spawning.
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Cannot resize image /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Ensure instance console log exists: /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:56 user nova-compute[72954]: WARNING nova.compute.manager [req-de7ffe59-2d13-44bf-8c59-f8c52a2b1e4c req-0168289d-9d9a-4089-a906-bcd9f4023ee4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state None.
Sep 04 23:29:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Successfully updated port: 81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquired lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updating instance_info_cache with network_info: [{"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Releasing lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Instance network_info: |[{"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Start _get_guest_xml network_info=[{"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:29:57 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:57 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1166778422',display_name='tempest-VolumesAssistedSnapshotsTest-server-1166778422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1166778422',id=10,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP96PwyWYwqUBEPVp1e+WzgCmhbRoPI6UO8M3D9lk9l/HE9z9iYpq0saXpWE8co8mZz1Ql+WHJaHzJlnD6k72Gz+CCYZzBHeyhDpF/4NX4ByvoMDFic/UbgEC+j8cHLKA==',key_name='tempest-keypair-393069947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a8fa3b55ac4df2a926625cae56e5da',ramdisk_id='',reservation_id='r-agu4xsut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1430164163',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1430164163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882d3b4957e4419b1b6afd01063a48d',uuid=ffeb12e3-6924-4536-9d90-23064511fee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converting VIF {"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lazy-loading 'pci_devices' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:29:57 user nova-compute[72954]:   <uuid>ffeb12e3-6924-4536-9d90-23064511fee8</uuid>
Sep 04 23:29:57 user nova-compute[72954]:   <name>instance-0000000a</name>
Sep 04 23:29:57 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:29:57 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:29:57 user nova-compute[72954]:   <metadata>
Sep 04 23:29:57 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:29:57 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1166778422</nova:name>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:29:57</nova:creationTime>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:29:57 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:29:57 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:owner>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:user uuid="a882d3b4957e4419b1b6afd01063a48d">tempest-VolumesAssistedSnapshotsTest-1430164163-project-member</nova:user>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:project uuid="58a8fa3b55ac4df2a926625cae56e5da">tempest-VolumesAssistedSnapshotsTest-1430164163</nova:project>
Sep 04 23:29:57 user nova-compute[72954]:       </nova:owner>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:29:57 user nova-compute[72954]:       <nova:ports>
Sep 04 23:29:57 user nova-compute[72954]:         <nova:port uuid="81b7735f-58c5-428a-89ef-7d7e1500e180">
Sep 04 23:29:57 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Sep 04 23:29:57 user nova-compute[72954]:         </nova:port>
Sep 04 23:29:57 user nova-compute[72954]:       </nova:ports>
Sep 04 23:29:57 user nova-compute[72954]:     </nova:instance>
Sep 04 23:29:57 user nova-compute[72954]:   </metadata>
Sep 04 23:29:57 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:29:57 user nova-compute[72954]:     <system>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="serial">ffeb12e3-6924-4536-9d90-23064511fee8</entry>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="uuid">ffeb12e3-6924-4536-9d90-23064511fee8</entry>
Sep 04 23:29:57 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:29:57 user nova-compute[72954]:     </system>
Sep 04 23:29:57 user nova-compute[72954]:   </sysinfo>
Sep 04 23:29:57 user nova-compute[72954]:   <os>
Sep 04 23:29:57 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:29:57 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:29:57 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:29:57 user nova-compute[72954]:   </os>
Sep 04 23:29:57 user nova-compute[72954]:   <features>
Sep 04 23:29:57 user nova-compute[72954]:     <acpi/>
Sep 04 23:29:57 user nova-compute[72954]:     <apic/>
Sep 04 23:29:57 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:29:57 user nova-compute[72954]:   </features>
Sep 04 23:29:57 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:29:57 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:29:57 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:29:57 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:29:57 user nova-compute[72954]:   </clock>
Sep 04 23:29:57 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:29:57 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:29:57 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:29:57 user nova-compute[72954]:   </cpu>
Sep 04 23:29:57 user nova-compute[72954]:   <devices>
Sep 04 23:29:57 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:29:57 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:29:57 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk"/>
Sep 04 23:29:57 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:29:57 user nova-compute[72954]:     </disk>
Sep 04 23:29:57 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:29:57 user nova-compute[72954]:       <mac address="fa:16:3e:cd:c4:1f"/>
Sep 04 23:29:57 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:57 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:29:57 user nova-compute[72954]:       <target dev="tap81b7735f-58"/>
Sep 04 23:29:57 user nova-compute[72954]:     </interface>
Sep 04 23:29:57 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:29:57 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/console.log" append="off"/>
Sep 04 23:29:57 user nova-compute[72954]:     </serial>
Sep 04 23:29:57 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:29:57 user nova-compute[72954]:     <video>
Sep 04 23:29:57 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:29:57 user nova-compute[72954]:     </video>
Sep 04 23:29:57 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:29:57 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:29:57 user nova-compute[72954]:     </rng>
Sep 04 23:29:57 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:29:57 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:29:57 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:29:57 user nova-compute[72954]:     </memballoon>
Sep 04 23:29:57 user nova-compute[72954]:   </devices>
Sep 04 23:29:57 user nova-compute[72954]: </domain>
Sep 04 23:29:57 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1166778422',display_name='tempest-VolumesAssistedSnapshotsTest-server-1166778422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1166778422',id=10,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP96PwyWYwqUBEPVp1e+WzgCmhbRoPI6UO8M3D9lk9l/HE9z9iYpq0saXpWE8co8mZz1Ql+WHJaHzJlnD6k72Gz+CCYZzBHeyhDpF/4NX4ByvoMDFic/UbgEC+j8cHLKA==',key_name='tempest-keypair-393069947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a8fa3b55ac4df2a926625cae56e5da',ramdisk_id='',reservation_id='r-agu4xsut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1430164163',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1430164163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882d3b4957e4419b1b6afd01063a48d',uuid=ffeb12e3-6924-4536-9d90-23064511fee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converting VIF {"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG os_vif [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b7735f-58, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81b7735f-58, col_values=(('external_ids', {'iface-id': '81b7735f-58c5-428a-89ef-7d7e1500e180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:c4:1f', 'vm-uuid': 'ffeb12e3-6924-4536-9d90-23064511fee8'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:57 user nova-compute[72954]: INFO os_vif [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58')
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] No waiting events found dispatching network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:57 user nova-compute[72954]: WARNING nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received unexpected event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 for instance with vm_state building and task_state spawning.
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:57 user nova-compute[72954]: WARNING nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce for instance with vm_state building and task_state spawning.
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-changed-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Refreshing instance network info cache due to event network-changed-81b7735f-58c5-428a-89ef-7d7e1500e180. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Acquiring lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Acquired lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.network.neutron [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Refreshing network info cache for port 81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:29:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] No VIF found with MAC fa:16:3e:cd:c4:1f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870198.3073988, 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] VM Resumed (Lifecycle Event)
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Instance spawned successfully.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870198.3126183, 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] VM Started (Lifecycle Event)
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Instance spawned successfully.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updated VIF entry in instance network info cache for port 81b7735f-58c5-428a-89ef-7d7e1500e180. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updating instance_info_cache with network_info: [{"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870198.3331218, 016c702e-e3f2-416d-8faa-164bb25eabdc => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] VM Resumed (Lifecycle Event)
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Releasing lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:58 user nova-compute[72954]: WARNING nova.compute.manager [req-b42cb2b4-eac2-48f9-b564-b43b3531e55c req-bb512372-b1d1-4465-b1b7-26e991884027 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce for instance with vm_state building and task_state spawning.
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Took 8.55 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Took 10.05 seconds to spawn the instance on the hypervisor.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870198.337514, 016c702e-e3f2-416d-8faa-164bb25eabdc => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] VM Started (Lifecycle Event)
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Took 10.81 seconds to build instance.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d6eb9816-f1e2-40a5-8cfc-fb8a1d0b23e0 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.962s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:58 user nova-compute[72954]: INFO nova.compute.manager [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Took 11.21 seconds to build instance.
Sep 04 23:29:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ffaa628b-2758-45cb-98c8-3bfa0b1841ea tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.337s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:29:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] No waiting events found dispatching network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:29:59 user nova-compute[72954]: WARNING nova.compute.manager [req-71b41cee-d579-4b5e-8fce-fa89dd5fbfc5 req-e88b15fd-4492-4534-a888-3a23f82845a3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received unexpected event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 for instance with vm_state building and task_state spawning.
Sep 04 23:30:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:30:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] No waiting events found dispatching network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:30:01 user nova-compute[72954]: WARNING nova.compute.manager [req-93626e80-7dba-44ea-b740-a85389b34f5d req-1bcf4b03-946c-48db-a3fa-3e4d7a77afc3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received unexpected event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 for instance with vm_state building and task_state spawning.
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870201.866804, ffeb12e3-6924-4536-9d90-23064511fee8 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:30:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] VM Resumed (Lifecycle Event)
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:30:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Instance spawned successfully.
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:30:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870201.8670335, ffeb12e3-6924-4536-9d90-23064511fee8 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:30:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] VM Started (Lifecycle Event)
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:30:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:30:02 user nova-compute[72954]: INFO nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Took 7.26 seconds to spawn the instance on the hypervisor.
Sep 04 23:30:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:30:02 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:30:02 user nova-compute[72954]: INFO nova.compute.manager [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Took 8.45 seconds to build instance.
Sep 04 23:30:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3dc75983-ca62-4a20-a57d-44584d82b99b tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.581s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:30:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:30:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7270MB free_disk=25.633750915527344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ffeb12e3-6924-4536-9d90-23064511fee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:30:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:10 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:10 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:10 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:30:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:30:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] No waiting events found dispatching network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:30:11 user nova-compute[72954]: WARNING nova.compute.manager [req-4c8005b2-0a7b-4d53-9fab-c39243c09584 req-56dd4cd1-9445-446b-92dd-82b2f62a3003 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received unexpected event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 for instance with vm_state active and task_state None.
Sep 04 23:30:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] No waiting events found dispatching network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:30:13 user nova-compute[72954]: WARNING nova.compute.manager [req-f80ab21b-6133-4134-85bf-921b8dadeca9 req-1a65855f-7e94-448a-9f09-90e2b6c3dedb service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received unexpected event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 for instance with vm_state active and task_state None.
Sep 04 23:30:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:30:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:30:39 user nova-compute[72954]: INFO nova.compute.claims [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Claim successful on node user
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:30:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:30:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:30:40 user nova-compute[72954]: INFO nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Booting with volume e5c04a2e-92f1-49aa-91f5-e20e20ece04b at /dev/vda
Sep 04 23:30:40 user nova-compute[72954]: DEBUG nova.policy [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '147ef3821ef349929c5bd9d6db7c55d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbd1f98271cc4223905a5e6077a93565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:30:40 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:30:40 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjzd1489l/privsep.sock']
Sep 04 23:30:40 user sudo[84484]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjzd1489l/privsep.sock
Sep 04 23:30:40 user sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Sep 04 23:30:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully created port: 6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully created port: 25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully created port: b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:41 user sudo[84484]: pam_unix(sudo:session): session closed for user root
Sep 04 23:30:41 user nova-compute[72954]: INFO oslo.privsep.daemon [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Spawned new privsep daemon via rootwrap
Sep 04 23:30:41 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 04 23:30:41 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 04 23:30:41 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Sep 04 23:30:41 user nova-compute[72954]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84490
Sep 04 23:30:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[93757c8f-1e7a-4796-848f-864735941b93]: (2,) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95050c46-9dc9-4f99-ae11-9ce1365b8ed5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.nvmeof [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f9d33a-f99b-456e-9538-0a1e1944516b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23c816-b6fb-4d0e-a669-94b683f4d9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[44923cae-5a53-47ae-879e-b65884443fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:42 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:30:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4545426-4917-448d-a1b4-5cbbe90f63ff]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== get_connector_properties: return (2118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating existing volume attachment record: 81a0c313-fc64-4857-8957-ef6306097080 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully created port: eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:43 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully created port: d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: 6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-6aebeec6-852d-44a2-9639-b0fbb738b2f2. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG nova.network.neutron [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port 6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:44 user nova-compute[72954]: DEBUG nova.network.neutron [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-060bd8ad-e25b-462a-a9de-065475995cc6 req-a71dcf07-d085-47a3-a82a-6f21dae1ea3f service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:45 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-d96e99b2-4640-481b-a8d5-f7c0d2f3d415. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: 151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a89961fb-c7e6-4003-bac2-1dd351a67ca6 req-7c5a2e81-9f3f-4837-ad65-4c101a71c491 service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: 25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-151677de-13d0-4b86-b6b4-3d81a9d3df85. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port 151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-25c6ae47-a009-4043-8f95-54b1203984d1. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port 25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d35e3c68-d06c-4e84-a97e-1df698a4f80a req-659a22bc-a928-4871-865e-d94029be172d service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-b8aa8333-4263-4ffe-ae0e-6aad0637a809. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Successfully updated port: d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-eb48d974-727f-4842-a1cc-d4e760222a33. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2cf4af93-7029-4b0e-819e-66f9b29e5451 req-28ce09dc-35dd-4248-87fb-e2e21bf6ea50 service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:30:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-d74083a5-5a71-450c-9dbb-c9f6be72c19d. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance network_info: |[{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:30:53 user nova-compute[72954]: INFO nova.compute.claims [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Claim successful on node user
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updated VIF entry in instance network info cache for port d74083a5-5a71-450c-9dbb-c9f6be72c19d. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-76b78cd5-7062-47d6-b7ea-3ab9b4239ad4 req-35bfa096-a987-4dcd-8e85-e175d68f3f85 service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:30:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:30:54 user nova-compute[72954]: INFO nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Booting with volume 89ee2fde-8c12-4f66-bbde-82e45d183ec5 at /dev/vda
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6de439-eaef-4ec8-af1c-013b44e73346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0207195-a018-4587-8b69-9260ec9f7e5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e4e242-5fef-4896-b054-72c275e20173]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[72812a9a-e638-4d8b-ab1b-de5d62cf433c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:54 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:30:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb119ead-265c-4429-851b-4f54c44ec545]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating existing volume attachment record: f667ec08-cc4f-49d5-995c-92eae6e7c35a {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:30:54 user nova-compute[72954]: DEBUG nova.policy [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65a8dc3d341a4ed588888bc9fae5c824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6d70ab74f67414b912af732dc455009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:30:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully created port: e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully created port: 45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:56 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully created port: 190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:56 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully created port: 2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully created port: c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:57 user nova-compute[72954]: INFO nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Booting with volume 5f6f9255-7e73-4740-a359-ca5937d2c5e2 at /dev/vdb
Sep 04 23:30:57 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed4ef03-62c3-4853-9aed-933daefe6e32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b49955-54e2-4df8-9af6-33c8c5d6e7ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6afaa4-1861-44b8-8e46-e375158a9a2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e3206a-9d58-408d-83d5-62b4b257f25a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:30:58 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6cf140-9fa5-4f92-8f8f-e2874debb9aa]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating existing volume attachment record: 696b6cbe-2012-4363-a4fd-6f5a50ae2b36 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:30:58 user nova-compute[72954]: INFO nova.compute.manager [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Rescuing
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d1376bb4-9309-4d2f-972b-4369f711de69 req-664fa3f6-8b8a-4af8-a9f6-3e298eb7558d service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:30:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:30:59 user nova-compute[72954]: WARNING nova.compute.manager [req-3ce58462-9e7e-4764-a2d9-27b38b041e45 req-2fa52244-ca9a-42a2-8d8a-64a21a0f4320 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state rescuing.
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: 1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:30:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance destroyed successfully.
Sep 04 23:30:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Attempting rescue
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72954) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:30:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Creating image(s)
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'trusted_certs' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue" returned: 0 in 0.048s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'migration_context' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.base [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c15ab7fd-25fc-42ba-a451-c91cfe60c884> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start _get_guest_xml network_info=[{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:4f:48:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.base [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c15ab7fd-25fc-42ba-a451-c91cfe60c884> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'numa_topology' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.base [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c15ab7fd-25fc-42ba-a451-c91cfe60c884> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:30:59 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:30:59 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'vcpu_model' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.base [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c15ab7fd-25fc-42ba-a451-c91cfe60c884> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1384140502',display_name='tempest-ServerRescueNegativeTestJSON-server-1384140502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1384140502',id=2,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-f7i1yg3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:27Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c15ab7fd-25fc-42ba-a451-c91cfe60c884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:4f:48:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:4f:48:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.objects.base [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c15ab7fd-25fc-42ba-a451-c91cfe60c884> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:30:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:30:59 user nova-compute[72954]:   <uuid>c15ab7fd-25fc-42ba-a451-c91cfe60c884</uuid>
Sep 04 23:30:59 user nova-compute[72954]:   <name>instance-00000002</name>
Sep 04 23:30:59 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:30:59 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:30:59 user nova-compute[72954]:   <metadata>
Sep 04 23:30:59 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:30:59 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1384140502</nova:name>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:30:59</nova:creationTime>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:30:59 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:30:59 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:owner>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:30:59 user nova-compute[72954]:       </nova:owner>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:30:59 user nova-compute[72954]:       <nova:ports>
Sep 04 23:30:59 user nova-compute[72954]:         <nova:port uuid="2ec776aa-6f1e-46ee-b753-ae93df0a91d3">
Sep 04 23:30:59 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Sep 04 23:30:59 user nova-compute[72954]:         </nova:port>
Sep 04 23:30:59 user nova-compute[72954]:       </nova:ports>
Sep 04 23:30:59 user nova-compute[72954]:     </nova:instance>
Sep 04 23:30:59 user nova-compute[72954]:   </metadata>
Sep 04 23:30:59 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:30:59 user nova-compute[72954]:     <system>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="serial">c15ab7fd-25fc-42ba-a451-c91cfe60c884</entry>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="uuid">c15ab7fd-25fc-42ba-a451-c91cfe60c884</entry>
Sep 04 23:30:59 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:30:59 user nova-compute[72954]:     </system>
Sep 04 23:30:59 user nova-compute[72954]:   </sysinfo>
Sep 04 23:30:59 user nova-compute[72954]:   <os>
Sep 04 23:30:59 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:30:59 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:30:59 user nova-compute[72954]:   </os>
Sep 04 23:30:59 user nova-compute[72954]:   <features>
Sep 04 23:30:59 user nova-compute[72954]:     <acpi/>
Sep 04 23:30:59 user nova-compute[72954]:     <apic/>
Sep 04 23:30:59 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:30:59 user nova-compute[72954]:   </features>
Sep 04 23:30:59 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:30:59 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:30:59 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:30:59 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:30:59 user nova-compute[72954]:   </clock>
Sep 04 23:30:59 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:30:59 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:30:59 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:30:59 user nova-compute[72954]:   </cpu>
Sep 04 23:30:59 user nova-compute[72954]:   <devices>
Sep 04 23:30:59 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:30:59 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:30:59 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue"/>
Sep 04 23:30:59 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:30:59 user nova-compute[72954]:     </disk>
Sep 04 23:30:59 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:30:59 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:30:59 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk"/>
Sep 04 23:30:59 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:30:59 user nova-compute[72954]:     </disk>
Sep 04 23:30:59 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:30:59 user nova-compute[72954]:       <mac address="fa:16:3e:4f:48:56"/>
Sep 04 23:30:59 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:30:59 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:30:59 user nova-compute[72954]:       <target dev="tap2ec776aa-6f"/>
Sep 04 23:30:59 user nova-compute[72954]:     </interface>
Sep 04 23:30:59 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:30:59 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/console.log" append="off"/>
Sep 04 23:30:59 user nova-compute[72954]:     </serial>
Sep 04 23:30:59 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:30:59 user nova-compute[72954]:     <video>
Sep 04 23:30:59 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:30:59 user nova-compute[72954]:     </video>
Sep 04 23:30:59 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:30:59 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:30:59 user nova-compute[72954]:     </rng>
Sep 04 23:30:59 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:30:59 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:30:59 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:30:59 user nova-compute[72954]:     </memballoon>
Sep 04 23:30:59 user nova-compute[72954]:   </devices>
Sep 04 23:30:59 user nova-compute[72954]: </domain>
Sep 04 23:30:59 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:31:00 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance destroyed successfully.
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: 18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:4f:48:56, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-1cb4bc78-e278-4890-a436-2f18e71ce882. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port 1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-18691478-b154-41b4-b40c-6003fc6c4a6a. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port 18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:31:00 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: 45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:01 user nova-compute[72954]: WARNING nova.compute.manager [req-69e43d04-d41b-4f3c-bedc-50239e54bac9 req-600e23c5-d962-417b-bebe-4a7db46b1318 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state rescuing.
Sep 04 23:31:01 user nova-compute[72954]: DEBUG nova.network.neutron [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-749e921f-f51d-4fe0-bc2c-94d13245881e req-6b55fc82-be15-49d7-85a2-c1cde575e3a1 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: 190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-45a30df0-88bc-4290-87ea-cf1415155d71. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.network.neutron [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port 45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.network.neutron [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:31:02 user nova-compute[72954]: INFO nova.compute.manager [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] instance snapshotting
Sep 04 23:31:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Beginning live snapshot process
Sep 04 23:31:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG nova.network.neutron [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa8168ce-542e-429f-b4aa-f93762e84b22 req-6460cdb7-7fd5-4bfa-98bf-cc84c004d9f2 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-changed-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing instance network info cache due to event network-changed-751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing network info cache for port 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:03 user nova-compute[72954]: WARNING nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state rescuing.
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:03 user nova-compute[72954]: WARNING nova.compute.manager [req-57a6bb9c-c98b-498c-a6d5-64462d4ecc76 req-ac307f31-f459-4189-a3ff-ce0a43fd8e5f service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state active and task_state rescuing.
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: 2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0.delta 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0.delta 1073741824" returned: 0 in 0.072s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Quiescing instance not available: QEMU guest agent is not enabled.
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72954) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Sep 04 23:31:03 user nova-compute[72954]: INFO nova.virt.libvirt.host [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] UEFI support detected
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for c15ab7fd-25fc-42ba-a451-c91cfe60c884 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870263.918916, c15ab7fd-25fc-42ba-a451-c91cfe60c884 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:03 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] VM Resumed (Lifecycle Event)
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5f5d5572-25c2-48f1-a7eb-f557986d1cc6 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updated VIF entry in instance network info cache for port 751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a8dc262-a5b4-46ac-a24f-687b0b887d06 req-d2217cdf-3918-4e41-bc8c-69057b6700df service nova] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:04 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] During sync_power_state the instance has a pending task (rescuing). Skip.
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870263.9254785, c15ab7fd-25fc-42ba-a451-c91cfe60c884 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:04 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] VM Started (Lifecycle Event)
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Successfully updated port: c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:04 user nova-compute[72954]: INFO nova.compute.manager [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] instance snapshotting
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:31:04 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Beginning live snapshot process
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-190ad02b-b44c-4060-b923-46b101806751. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:04 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:31:04 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Skipping quiescing instance: QEMU guest agent is not enabled.
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0.delta /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6.delta 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6.delta 1073741824" returned: 0 in 0.074s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Quiescing instance not available: QEMU guest agent is not enabled.
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0.delta /opt/stack/data/nova/instances/snapshots/tmp65z0xqsr/f7a0f9bf0a3043d499bcb1aba99ec6b0" returned: 0 in 0.498s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Snapshot extracted, beginning image upload
Sep 04 23:31:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-changed-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing instance network info cache due to event network-changed-cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG nova.network.neutron [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing network info cache for port cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:31:06 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Skipping quiescing instance: QEMU guest agent is not enabled.
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6.delta /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated VIF entry in instance network info cache for port cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4662783-96f9-4e3e-987b-aa1008d665c9 req-ffde8a3c-2106-477e-a588-f69fe9fe6501 service nova] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6.delta /opt/stack/data/nova/instances/snapshots/tmpwy9irihi/f4e2a166a719450c9723278e0ee918b6" returned: 0 in 0.376s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Snapshot extracted, beginning image upload
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance network_info: |[{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port 190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updated VIF entry in instance network info cache for port 190ad02b-b44c-4060-b923-46b101806751. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port 2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Snapshot image upload complete
Sep 04 23:31:09 user nova-compute[72954]: INFO nova.compute.manager [None req-ec31899a-12c0-4f88-bbe8-6e766e6ad8bc tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Took 6.44 seconds to snapshot the instance on the hypervisor.
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updated VIF entry in instance network info cache for port 2aa360bc-13ab-44ad-9d58-eb5171d0c5cf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updated VIF entry in instance network info cache for port c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ea8adacd-fa77-4ab4-b084-8674d8cb4478 req-43e4dcf8-d16f-4ea7-8b08-b83d54205477 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=6952MB free_disk=25.534812927246094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Snapshot image upload complete
Sep 04 23:31:10 user nova-compute[72954]: INFO nova.compute.manager [None req-343e7b64-fdd2-432a-828a-048ef7e079b5 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Took 6.03 seconds to snapshot the instance on the hypervisor.
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ffeb12e3-6924-4536-9d90-23064511fee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 621de8a1-f2a6-4337-a53e-6667555c8532 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:31:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:11 user nova-compute[72954]: INFO nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Booting with volume a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 at /dev/vdb
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[87afabbd-a1cc-4368-a3c7-d7258f198990]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9b1e1-e4ef-410a-b499-b0ac4500bc12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b2d5e-99bb-4e07-9765-7efcb3462b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73bf175-edc5-4ea7-9083-e66c09d2b2c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:11 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb2339-a581-4d2b-8a13-6a3a1f508f52]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating existing volume attachment record: 9053b071-858b-4c86-870e-c775049c4bc7 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:31:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:13 user nova-compute[72954]: INFO nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Booting with volume 19ef8de5-448a-411c-8307-755659c81fac at /dev/vdc
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc43e9b-c856-422b-8499-324d235e7e12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd607b-083b-4c7f-9f9a-aa0ce2ebd115]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f667ae2-c588-4cb9-bd94-5088cf222279]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6e5e7d-b273-44c7-8d60-647cbeb7f256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:14 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4d30c0-daad-40b2-b71a-e001da5e66b0]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG os_brick.utils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:14 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating existing volume attachment record: 4ccea078-56a4-4564-b035-e6317592e114 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-changed-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Refreshing instance network info cache due to event network-changed-e25d703b-4dcd-4550-87c9-c254515dcacf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] Acquiring lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] Acquired lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Refreshing network info cache for port e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updated VIF entry in instance network info cache for port e25d703b-4dcd-4550-87c9-c254515dcacf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating instance_info_cache with network_info: [{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d0ace59a-be79-4032-a313-61fd00c0eefc req-8ed1145a-435d-4bfd-9335-2129d603e4b1 service nova] Releasing lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG nova.objects.instance [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'flavor' on Instance uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:25 user nova-compute[72954]: INFO nova.compute.manager [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Attaching volume ba6ee640-c74c-4ae7-b720-44d17d47632d to /dev/vdb
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:31:25 user nova-compute[72954]: INFO nova.compute.claims [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Claim successful on node user
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.utils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4efea8-d55f-47f6-857f-1a4962b1dc05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3d22a-54e2-4d4e-bc18-d32009599755]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5320be5-285e-4e9e-befb-6f4068ecad64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b972d8-0f07-48c5-b889-e5be71922067]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:25 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfc4fbc-8e93-4c7d-a1b3-19333dbeede1]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG os_brick.utils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:25 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating existing volume attachment record: 0a095480-9947-4c5c-a966-2862631ba26f {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:31:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.policy [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39677924cdc04659a3a09b7a18197550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67408b8757584970a53ba69cedbb75b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:31:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Creating image(s)
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "/opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "/opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "/opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk 1073741824" returned: 0 in 0.047s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Successfully created port: 6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.227s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Cannot resize image /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Ensure instance console log exists: /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Successfully updated port: 6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquired lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-changed-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Refreshing instance network info cache due to event network-changed-6177b08b-09e9-4936-8c6b-38978698730b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] Acquiring lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:31:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Booting with volume 8f5baaf7-e250-4292-9001-458dea30cda2 at /dev/vdc
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d30501a-9a38-449a-81b3-52c47dc76d67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Updating instance_info_cache with network_info: [{"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[00968a19-61c4-4204-ac1e-3f36231b8f4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a5162-7402-44ec-8a86-f985ce2c9d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Releasing lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Instance network_info: |[{"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b1e30a-eaf6-4e1d-b632-d295b39361c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] Acquired lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Refreshing network info cache for port 6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Start _get_guest_xml network_info=[{"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:28 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2aba85-c7ac-44e5-83a1-23bd8684ebb4]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating existing volume attachment record: 69a51f9a-e6ba-444e-b1c4-45119b851458 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-490238502',display_name='tempest-VolumesNegativeTest-instance-490238502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-490238502',id=13,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67408b8757584970a53ba69cedbb75b2',ramdisk_id='',reservation_id='r-vqsm3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-702867806',owner_user_name='tempest-VolumesNegativeTest-702867806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:31:26Z,user_data=None,user_id='39677924cdc04659a3a09b7a18197550',uuid=59f79766-4fb0-43e2-9f3e-9eed3d9129bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converting VIF {"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lazy-loading 'pci_devices' on Instance uuid 59f79766-4fb0-43e2-9f3e-9eed3d9129bd {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:31:28 user nova-compute[72954]:   <uuid>59f79766-4fb0-43e2-9f3e-9eed3d9129bd</uuid>
Sep 04 23:31:28 user nova-compute[72954]:   <name>instance-0000000d</name>
Sep 04 23:31:28 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:31:28 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:31:28 user nova-compute[72954]:   <metadata>
Sep 04 23:31:28 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:31:28 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:name>tempest-VolumesNegativeTest-instance-490238502</nova:name>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:31:28</nova:creationTime>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:31:28 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:31:28 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:owner>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:user uuid="39677924cdc04659a3a09b7a18197550">tempest-VolumesNegativeTest-702867806-project-member</nova:user>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:project uuid="67408b8757584970a53ba69cedbb75b2">tempest-VolumesNegativeTest-702867806</nova:project>
Sep 04 23:31:28 user nova-compute[72954]:       </nova:owner>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:31:28 user nova-compute[72954]:       <nova:ports>
Sep 04 23:31:28 user nova-compute[72954]:         <nova:port uuid="6177b08b-09e9-4936-8c6b-38978698730b">
Sep 04 23:31:28 user nova-compute[72954]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
Sep 04 23:31:28 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:28 user nova-compute[72954]:       </nova:ports>
Sep 04 23:31:28 user nova-compute[72954]:     </nova:instance>
Sep 04 23:31:28 user nova-compute[72954]:   </metadata>
Sep 04 23:31:28 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:31:28 user nova-compute[72954]:     <system>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="serial">59f79766-4fb0-43e2-9f3e-9eed3d9129bd</entry>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="uuid">59f79766-4fb0-43e2-9f3e-9eed3d9129bd</entry>
Sep 04 23:31:28 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:31:28 user nova-compute[72954]:     </system>
Sep 04 23:31:28 user nova-compute[72954]:   </sysinfo>
Sep 04 23:31:28 user nova-compute[72954]:   <os>
Sep 04 23:31:28 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:31:28 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:31:28 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:31:28 user nova-compute[72954]:   </os>
Sep 04 23:31:28 user nova-compute[72954]:   <features>
Sep 04 23:31:28 user nova-compute[72954]:     <acpi/>
Sep 04 23:31:28 user nova-compute[72954]:     <apic/>
Sep 04 23:31:28 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:31:28 user nova-compute[72954]:   </features>
Sep 04 23:31:28 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:31:28 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:31:28 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:31:28 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:31:28 user nova-compute[72954]:   </clock>
Sep 04 23:31:28 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:31:28 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:31:28 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:31:28 user nova-compute[72954]:   </cpu>
Sep 04 23:31:28 user nova-compute[72954]:   <devices>
Sep 04 23:31:28 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:31:28 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:31:28 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk"/>
Sep 04 23:31:28 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:31:28 user nova-compute[72954]:     </disk>
Sep 04 23:31:28 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:28 user nova-compute[72954]:       <mac address="fa:16:3e:e7:1f:57"/>
Sep 04 23:31:28 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:28 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:28 user nova-compute[72954]:       <target dev="tap6177b08b-09"/>
Sep 04 23:31:28 user nova-compute[72954]:     </interface>
Sep 04 23:31:28 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:31:28 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/console.log" append="off"/>
Sep 04 23:31:28 user nova-compute[72954]:     </serial>
Sep 04 23:31:28 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:31:28 user nova-compute[72954]:     <video>
Sep 04 23:31:28 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:28 user nova-compute[72954]:     </video>
Sep 04 23:31:28 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:31:28 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:31:28 user nova-compute[72954]:     </rng>
Sep 04 23:31:28 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:31:28 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:31:28 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:31:28 user nova-compute[72954]:     </memballoon>
Sep 04 23:31:28 user nova-compute[72954]:   </devices>
Sep 04 23:31:28 user nova-compute[72954]: </domain>
Sep 04 23:31:28 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-490238502',display_name='tempest-VolumesNegativeTest-instance-490238502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-490238502',id=13,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67408b8757584970a53ba69cedbb75b2',ramdisk_id='',reservation_id='r-vqsm3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-702867806',owner_user_name='tempest-VolumesNegativeTest-702867806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:31:26Z,user_data=None,user_id='39677924cdc04659a3a09b7a18197550',uuid=59f79766-4fb0-43e2-9f3e-9eed3d9129bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converting VIF {"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG os_vif [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6177b08b-09, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6177b08b-09, col_values=(('external_ids', {'iface-id': '6177b08b-09e9-4936-8c6b-38978698730b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:1f:57', 'vm-uuid': '59f79766-4fb0-43e2-9f3e-9eed3d9129bd'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:28 user nova-compute[72954]: INFO os_vif [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09')
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] No VIF found with MAC fa:16:3e:e7:1f:57, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Updated VIF entry in instance network info cache for port 6177b08b-09e9-4936-8c6b-38978698730b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Updating instance_info_cache with network_info: [{"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a38131ac-e146-4238-8f93-308e03aebed9 req-548f1fab-2994-40d8-82ac-1ca8973c2de0 service nova] Releasing lock "refresh_cache-59f79766-4fb0-43e2-9f3e-9eed3d9129bd" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:31:30 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Creating image(s)
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Ensure instance console log exists: /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Start _get_guest_xml network_info=[{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDKQhXny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '621de8a1-f2a6-4337-a53e-6667555c8532', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5c04a2e-92f1-49aa-91f5-e20e20ece04b', 'serial': 'e5c04a2e-92f1-49aa-91f5-e20e20ece04b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '81a0c313-fc64-4857-8957-ef6306097080', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADxkMUpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '621de8a1-f2a6-4337-a53e-6667555c8532', 'attached_at': '', 'detached_at': '', 'volume_id': '5f6f9255-7e73-4740-a359-ca5937d2c5e2', 'serial': '5f6f9255-7e73-4740-a359-ca5937d2c5e2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '696b6cbe-2012-4363-a4fd-6f5a50ae2b36', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNXatypz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '621de8a1-f2a6-4337-a53e-6667555c8532', 'attached_at': '', 'detached_at': '', 'volume_id': '19ef8de5-448a-411c-8307-755659c81fac', 'serial': '19ef8de5-448a-411c-8307-755659c81fac'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '4ccea078-56a4-4564-b035-e6317592e114', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] No waiting events found dispatching network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:30 user nova-compute[72954]: WARNING nova.compute.manager [req-c20a4101-7658-4e02-9252-766f68ff551f req-0d9be47f-1226-4a09-813c-07ae3c8b9469 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received unexpected event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b for instance with vm_state building and task_state spawning.
Sep 04 23:31:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connector [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Factory for ISCSI on None {{(pid=72954) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDKQhXny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:30 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:30 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:30 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa2696-694e-4b3e-a96a-6dc56db5ea88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:30 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc9143c-43dc-4104-b1ba-5921a3783310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b] added
Sep 04 23:31:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb809233-be15-4072-98ee-442b3eeb564e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0621bf-bc68-4ff3-a7c9-9e2b065312a7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDKQhXny {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDKQhXny" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0dbda4-c127-4a93-8544-6c2b30ea7ec2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDKQhXny'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da8e2f-8982-44b2-901a-6c7e7baaf783]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[556bbe48-c154-4ad4-9274-478decfed1e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:31:30 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:31:30 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:30 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:31:30 user nova-compute[72954]: 
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce82770-7de7-4aed-878d-6901574aa291]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260]
Sep 04 23:31:30 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058f541-1e5d-4f04-b66e-efc904bee43b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794f54c-96a4-4af3-a874-71a96c33048c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4241dc1-8f19-423d-8d70-ee3749637f7f]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDKQhXny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23230653863333231', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230653863333231', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADxkMUpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:31 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:31 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:31 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8926c12-8284-47f4-9c3a-076b454e6bc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:31 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e529c4-e550-4ab1-9c6f-12f42934d886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2] added
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[289400ab-3993-4ae0-b33e-818978ef7e17]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1bb13-54d5-422c-9bbf-f7a15433ed0b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADxkMUpq {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADxkMUpq" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[578b16fa-aa54-484e-9b19-a9bfe69ac4c5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADxkMUpq'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5d0901-9774-445e-b568-6c848a5da9cb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5af400-6379-4244-96da-7f3efc40211f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db1e8e-61f8-4acf-95b2-93abe3becbe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260]
Sep 04 23:31:31 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee12aa-6908-4318-9730-cdec0d93378b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eb91a7-48c9-4136-bb0b-e38a54bdab7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:31 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:31 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[be001e1d-b62b-4af8-aabd-112b1bbd977f]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADxkMUpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870291.9097366, 59f79766-4fb0-43e2-9f3e-9eed3d9129bd => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] VM Resumed (Lifecycle Event)
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:31:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Instance spawned successfully.
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:31 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870291.9111369, 59f79766-4fb0-43e2-9f3e-9eed3d9129bd => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] VM Started (Lifecycle Event)
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:32 user nova-compute[72954]: INFO nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Took 5.56 seconds to spawn the instance on the hypervisor.
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:32 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] No waiting events found dispatching network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:32 user nova-compute[72954]: WARNING nova.compute.manager [req-f3e9c0ae-c242-47c3-a25e-bd1ce3e9bd1d req-f787960e-adc6-4931-823c-216e440eecaf service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received unexpected event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b for instance with vm_state building and task_state spawning.
Sep 04 23:31:32 user nova-compute[72954]: INFO nova.compute.manager [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Took 6.47 seconds to build instance.
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-edbd2abd-95b5-43aa-8f76-95fb67dfee0e tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.574s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26166396633653933', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166396633653933', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNXatypz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:32 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee5294a-c438-4736-bdec-d05ad2a78ff8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:32 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886a92a-fd20-4781-a491-a07e6d28e547]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac] added
Sep 04 23:31:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[86649165-450e-4565-8aa1-00783414181d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a24aea3-b171-498f-a2ab-22528bf89d4d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNXatypz {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNXatypz" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad39960-6a9e-49a6-8e06-fb6220fd8f17]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNXatypz'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb43523-23de-4be9-9810-858fb74431e5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd5b2a-cc1b-4480-8371-909530722b8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2add6-c026-4981-86a8-9b46addf1d02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260]
Sep 04 23:31:33 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3365bee3-40de-4f40-869e-cc62c25fc4bc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0856d-bf53-44af-8bd6-6a66ba313a0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:33 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb01490-82c3-4009-a78e-2b13ffbdfb63]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-changed-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Refreshing instance network info cache due to event network-changed-ae69a72e-e5a1-4294-ab47-343a59702ee3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] Acquiring lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] Acquired lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Refreshing network info cache for port ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNXatypz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23532646364653930', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532646364653930', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lazy-loading 'pci_devices' on Instance uuid 621de8a1-f2a6-4337-a53e-6667555c8532 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:31:34 user nova-compute[72954]:   <uuid>621de8a1-f2a6-4337-a53e-6667555c8532</uuid>
Sep 04 23:31:34 user nova-compute[72954]:   <name>instance-0000000b</name>
Sep 04 23:31:34 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:31:34 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:31:34 user nova-compute[72954]:   <metadata>
Sep 04 23:31:34 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:31:34 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:name>tempest-device-tagging-server-1780668482</nova:name>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:31:30</nova:creationTime>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:31:34 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:31:34 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:owner>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:user uuid="147ef3821ef349929c5bd9d6db7c55d1">tempest-TaggedBootDevicesTest-32214521-project-member</nova:user>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:project uuid="bbd1f98271cc4223905a5e6077a93565">tempest-TaggedBootDevicesTest-32214521</nova:project>
Sep 04 23:31:34 user nova-compute[72954]:       </nova:owner>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:31:34 user nova-compute[72954]:       <nova:ports>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="6aebeec6-852d-44a2-9639-b0fbb738b2f2">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="d96e99b2-4640-481b-a8d5-f7c0d2f3d415">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="151677de-13d0-4b86-b6b4-3d81a9d3df85">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="25c6ae47-a009-4043-8f95-54b1203984d1">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="b8aa8333-4263-4ffe-ae0e-6aad0637a809">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="eb48d974-727f-4842-a1cc-d4e760222a33">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:         <nova:port uuid="d74083a5-5a71-450c-9dbb-c9f6be72c19d">
Sep 04 23:31:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Sep 04 23:31:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:34 user nova-compute[72954]:       </nova:ports>
Sep 04 23:31:34 user nova-compute[72954]:     </nova:instance>
Sep 04 23:31:34 user nova-compute[72954]:   </metadata>
Sep 04 23:31:34 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:31:34 user nova-compute[72954]:     <system>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="serial">621de8a1-f2a6-4337-a53e-6667555c8532</entry>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="uuid">621de8a1-f2a6-4337-a53e-6667555c8532</entry>
Sep 04 23:31:34 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:31:34 user nova-compute[72954]:     </system>
Sep 04 23:31:34 user nova-compute[72954]:   </sysinfo>
Sep 04 23:31:34 user nova-compute[72954]:   <os>
Sep 04 23:31:34 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:31:34 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:31:34 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:31:34 user nova-compute[72954]:   </os>
Sep 04 23:31:34 user nova-compute[72954]:   <features>
Sep 04 23:31:34 user nova-compute[72954]:     <acpi/>
Sep 04 23:31:34 user nova-compute[72954]:     <apic/>
Sep 04 23:31:34 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:31:34 user nova-compute[72954]:   </features>
Sep 04 23:31:34 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:31:34 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:31:34 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:31:34 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:31:34 user nova-compute[72954]:   </clock>
Sep 04 23:31:34 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:31:34 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:31:34 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:31:34 user nova-compute[72954]:   </cpu>
Sep 04 23:31:34 user nova-compute[72954]:   <devices>
Sep 04 23:31:34 user nova-compute[72954]:     <disk type="file" device="cdrom">
Sep 04 23:31:34 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none"/>
Sep 04 23:31:34 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/disk.config"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="hda" bus="ide"/>
Sep 04 23:31:34 user nova-compute[72954]:     </disk>
Sep 04 23:31:34 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:34 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:34 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <serial>e5c04a2e-92f1-49aa-91f5-e20e20ece04b</serial>
Sep 04 23:31:34 user nova-compute[72954]:     </disk>
Sep 04 23:31:34 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:34 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:34 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <serial>5f6f9255-7e73-4740-a359-ca5937d2c5e2</serial>
Sep 04 23:31:34 user nova-compute[72954]:     </disk>
Sep 04 23:31:34 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:34 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:34 user nova-compute[72954]:       <source dev="/dev/sdd"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="vdc" bus="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <serial>19ef8de5-448a-411c-8307-755659c81fac</serial>
Sep 04 23:31:34 user nova-compute[72954]:     </disk>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:74:77:a0"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tap6aebeec6-85"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:3d:f2:07"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tapd96e99b2-46"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:8f:cf:10"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tap151677de-13"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:40:89:08"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tap25c6ae47-a0"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:85:15:9d"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tapb8aa8333-42"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:5d:a2:ab"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tapeb48d974-72"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:34 user nova-compute[72954]:       <mac address="fa:16:3e:ba:b8:8f"/>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:34 user nova-compute[72954]:       <target dev="tapd74083a5-5a"/>
Sep 04 23:31:34 user nova-compute[72954]:     </interface>
Sep 04 23:31:34 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:31:34 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/console.log" append="off"/>
Sep 04 23:31:34 user nova-compute[72954]:     </serial>
Sep 04 23:31:34 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:31:34 user nova-compute[72954]:     <video>
Sep 04 23:31:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:34 user nova-compute[72954]:     </video>
Sep 04 23:31:34 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:31:34 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:31:34 user nova-compute[72954]:     </rng>
Sep 04 23:31:34 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:31:34 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:31:34 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:31:34 user nova-compute[72954]:     </memballoon>
Sep 04 23:31:34 user nova-compute[72954]:   </devices>
Sep 04 23:31:34 user nova-compute[72954]: </domain>
Sep 04 23:31:34 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lazy-loading 'flavor' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aebeec6-85, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6aebeec6-85, col_values=(('external_ids', {'iface-id': '6aebeec6-852d-44a2-9639-b0fbb738b2f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:77:a0', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd96e99b2-46, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd96e99b2-46, col_values=(('external_ids', {'iface-id': 'd96e99b2-4640-481b-a8d5-f7c0d2f3d415', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:f2:07', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap151677de-13, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap151677de-13, col_values=(('external_ids', {'iface-id': '151677de-13d0-4b86-b6b4-3d81a9d3df85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:cf:10', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25c6ae47-a0, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25c6ae47-a0, col_values=(('external_ids', {'iface-id': '25c6ae47-a009-4043-8f95-54b1203984d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:89:08', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8aa8333-42, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8aa8333-42, col_values=(('external_ids', {'iface-id': 'b8aa8333-4263-4ffe-ae0e-6aad0637a809', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:15:9d', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updated VIF entry in instance network info cache for port ae69a72e-e5a1-4294-ab47-343a59702ee3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updating instance_info_cache with network_info: [{"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46cd2b43-48d7-4f81-97f1-8fceceee2494 req-f05994d7-260c-420f-8b2e-47620b682ff6 service nova] Releasing lock "refresh_cache-e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb48d974-72, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb48d974-72, col_values=(('external_ids', {'iface-id': 'eb48d974-727f-4842-a1cc-d4e760222a33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:a2:ab', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:34 user nova-compute[72954]: INFO nova.compute.manager [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attaching volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db to /dev/vdb
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd74083a5-5a, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd74083a5-5a, col_values=(('external_ids', {'iface-id': 'd74083a5-5a71-450c-9dbb-c9f6be72c19d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:b8:8f', 'vm-uuid': '621de8a1-f2a6-4337-a53e-6667555c8532'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.utils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:34 user nova-compute[72954]: INFO os_vif [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a')
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c877792-97b1-4522-8844-596f0c531098]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a775cc5-4946-4757-8b2f-0dfce6cb3372]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5523049c-7e5d-422a-a491-ac0a3008bdb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9148413f-048b-4e4b-8cf2-5e5f3e943fde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] No BDM found with device name hda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] No VIF found with MAC fa:16:3e:74:77:a0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] No VIF found with MAC fa:16:3e:85:15:9d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Using config drive
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:34 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6e7ac3-83fa-4ccd-9dc7-b6c220b7a0b9]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG os_brick.utils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:34 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updating existing volume attachment record: d121b4ee-423a-4d62-8390-ef81deb9fb12 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Creating config drive at /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/disk.config
Sep 04 23:31:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5d2gid5g {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5d2gid5g" returned: 0 in 0.060s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:37 user nova-compute[72954]: WARNING nova.compute.manager [req-bfdfc058-4e08-4879-aede-da120ac32d0e req-b509654f-eaf4-40e6-ad9e-32a3aa7ea19f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 for instance with vm_state building and task_state spawning.
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:37 user nova-compute[72954]: WARNING nova.compute.manager [req-62747a75-0bf8-4cf9-9d9c-4466f1626d41 req-a51ca539-72c4-4c4c-be4c-d7bc21e6d4cd service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 for instance with vm_state building and task_state spawning.
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-changed-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Refreshing instance network info cache due to event network-changed-d249f205-6e80-4b22-9a2d-c9924bb04418. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] Acquiring lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] Acquired lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.network.neutron [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Refreshing network info cache for port d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-4bf7d4d2-6025-4485-aed6-d0344b695876 req-1ddf3fbb-6ded-499e-8746-f8b428f41425 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:39 user nova-compute[72954]: WARNING nova.compute.manager [req-30a8aaa8-6016-40f2-933a-718e0c9307ad req-525cd46b-85f6-4bbb-a087-d040e2dbb24d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 for instance with vm_state building and task_state spawning.
Sep 04 23:31:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.network.neutron [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updated VIF entry in instance network info cache for port d249f205-6e80-4b22-9a2d-c9924bb04418. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:39 user nova-compute[72954]: DEBUG nova.network.neutron [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updating instance_info_cache with network_info: [{"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-51d8afac-232f-42fb-9000-3203e93b6eff req-161603b9-576c-4be4-8c40-857814c11443 service nova] Releasing lock "refresh_cache-016c702e-e3f2-416d-8faa-164bb25eabdc" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'pci_requests' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.objects.base [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Object Instance<6f2dd93c-0564-4e76-8219-a4e5a7aaace5> lazy-loaded attributes: flavor,pci_requests {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.policy [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7cb888448fb4c389096c8be0e881847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed713e4a84fe4a8eb43e342c36a2f860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Successfully created port: 6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-changed-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing instance network info cache due to event network-changed-1d7af612-bd03-4234-b329-92603ec8e2ce. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing network info cache for port 1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:41 user nova-compute[72954]: WARNING nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d for instance with vm_state building and task_state spawning.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:41 user nova-compute[72954]: WARNING nova.compute.manager [req-1a923da4-4af7-4ad3-a677-46d006dd3c1a req-23adbb0f-9325-4e73-b797-0d259e614cb4 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d for instance with vm_state building and task_state spawning.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870301.6008966, 621de8a1-f2a6-4337-a53e-6667555c8532 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] VM Resumed (Lifecycle Event)
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance spawned successfully.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870301.6054392, 621de8a1-f2a6-4337-a53e-6667555c8532 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] VM Started (Lifecycle Event)
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Took 11.66 seconds to spawn the instance on the hypervisor.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:41 user nova-compute[72954]: INFO nova.compute.manager [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Took 62.77 seconds to build instance.
Sep 04 23:31:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3e4a1386-1af0-4d39-a20e-9112392aefac tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.885s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updated VIF entry in instance network info cache for port 1d7af612-bd03-4234-b329-92603ec8e2ce. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-26765733-8841-4386-baeb-d5decbee4887 req-b17fabb3-ce63-4389-bb82-427cde951627 service nova] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Successfully updated port: 6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG os_vif [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6249745d-a6, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6249745d-a6, col_values=(('external_ids', {'iface-id': '6249745d-a6db-4a0d-bcc1-eaed651cb1e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:4b:d8', 'vm-uuid': '6f2dd93c-0564-4e76-8219-a4e5a7aaace5'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:42 user nova-compute[72954]: INFO os_vif [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6')
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] attach device xml: <interface type="ethernet">
Sep 04 23:31:42 user nova-compute[72954]:   <mac address="fa:16:3e:e0:4b:d8"/>
Sep 04 23:31:42 user nova-compute[72954]:   <model type="virtio"/>
Sep 04 23:31:42 user nova-compute[72954]:   <mtu size="1442"/>
Sep 04 23:31:42 user nova-compute[72954]:   <target dev="tap6249745d-a6"/>
Sep 04 23:31:42 user nova-compute[72954]: </interface>
Sep 04 23:31:42 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:31:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-changed-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing instance network info cache due to event network-changed-6249745d-a6db-4a0d-bcc1-eaed651cb1e1. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Refreshing network info cache for port 6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:43 user nova-compute[72954]: WARNING nova.compute.manager [req-fc7323c2-0e75-48c3-875b-dc16d1dcd7b9 req-3c2459a1-2682-4def-8943-9ef7934ec1dd service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 for instance with vm_state active and task_state None.
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name hda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No VIF found with MAC fa:16:3e:a2:3d:13, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:31:43 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:31:43</nova:creationTime>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:31:43 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:31:43 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:owner>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:31:43 user nova-compute[72954]:   </nova:owner>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:31:43 user nova-compute[72954]:   <nova:ports>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:31:43 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:31:43 user nova-compute[72954]:     </nova:port>
Sep 04 23:31:43 user nova-compute[72954]:     <nova:port uuid="6249745d-a6db-4a0d-bcc1-eaed651cb1e1">
Sep 04 23:31:43 user nova-compute[72954]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Sep 04 23:31:43 user nova-compute[72954]:     </nova:port>
Sep 04 23:31:43 user nova-compute[72954]:   </nova:ports>
Sep 04 23:31:43 user nova-compute[72954]: </nova:instance>
Sep 04 23:31:43 user nova-compute[72954]:  {{(pid=72954) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e212feb4-ea47-460c-a695-a1626a4ca1f7 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.557s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG nova.network.neutron [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updated VIF entry in instance network info cache for port 6249745d-a6db-4a0d-bcc1-eaed651cb1e1. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG nova.network.neutron [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-491ef222-7a14-427f-ad81-d632dcf09e6b req-5ea4405f-cac7-42cb-a2a5-8aa4d9fb790d service nova] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnmOlaMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:44 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81cb020-95e9-4ffd-abf4-066feccb155b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:44 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33bce7d-8360-4411-8b69-8cf2fdecdcb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d] added
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3137c025-8af7-46d4-a325-696447de9978]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91801dee-3a43-4d62-b946-b885d60ba41e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnmOlaMV {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnmOlaMV" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[100170e4-1241-406d-a492-dd2b1b748796]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnmOlaMV'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a402b-0d03-41fb-875a-244bfcc0e019]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c95c23-549e-46af-9552-1110e06f24de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410b2cf-3172-4948-903f-ec5e78fa44b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260]
Sep 04 23:31:44 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ac84d-85c8-4d0d-b05d-6178fd9457ce]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ca280-b8c6-4609-823d-0a69a9cbf761]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:44 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5ea26-a92f-4049-9ef9-51e9b346f675]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnmOlaMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-changed-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Refreshing instance network info cache due to event network-changed-81b7735f-58c5-428a-89ef-7d7e1500e180. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] Acquiring lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] Acquired lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Refreshing network info cache for port 81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:45 user nova-compute[72954]: INFO nova.compute.manager [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Attaching volume 1996cea2-2cf9-40e0-b898-4bccb9831938 to /dev/vdb
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.utils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b623a4f-1e42-4e7b-b177-128c1e9ad5ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778c7c8-1ab5-4722-9cdf-9a6062dfbc73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c0280b-7aba-4161-9e79-2650f7d45634]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead97fa-c12f-4f46-995b-11920c33f26c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:45 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f8cf1-caad-439a-81d0-2044221617dc]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.utils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating existing volume attachment record: 33ae9614-5cd6-4922-bb70-229f955bd762 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.objects.instance [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lazy-loading 'flavor' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:45 user nova-compute[72954]: WARNING nova.compute.manager [req-4cb945e1-5b70-44c6-9aa6-28707d74e21f req-adcf300e-a37d-4b2c-a7a8-07f5c5e436d8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 for instance with vm_state active and task_state None.
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23462303362663765', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462303362663765', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.objects.instance [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'flavor' on Instance uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updated VIF entry in instance network info cache for port 81b7735f-58c5-428a-89ef-7d7e1500e180. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updating instance_info_cache with network_info: [{"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:31:45 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:45 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:31:45 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:31:45 user nova-compute[72954]:   <serial>ba6ee640-c74c-4ae7-b720-44d17d47632d</serial>
Sep 04 23:31:45 user nova-compute[72954]: </disk>
Sep 04 23:31:45 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9bdcec07-97ac-49f4-8d81-bf814d9cbea2 req-0653b10b-acc8-47dd-ba1d-6e5255168500 service nova] Releasing lock "refresh_cache-ffeb12e3-6924-4536-9d90-23064511fee8" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:31:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No VIF found with MAC fa:16:3e:4e:93:05, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-adf5129a-56e2-4e4d-8861-e0c289b9836a tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.787s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:46 user nova-compute[72954]: INFO nova.compute.manager [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Attaching volume 0b6f82f4-b342-4325-88ec-8827e63cbf91 to /dev/vdb
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:31:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Creating image(s)
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Start _get_guest_xml network_info=[{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDyahulx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f', 'attached_at': '', 'detached_at': '', 'volume_id': '89ee2fde-8c12-4f66-bbde-82e45d183ec5', 'serial': '89ee2fde-8c12-4f66-bbde-82e45d183ec5'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'f667ec08-cc4f-49d5-995c-92eae6e7c35a', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyVvLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248', 'serial': 'a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '9053b071-858b-4c86-870e-c775049c4bc7', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FosdnNLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f', 'attached_at': '', 'detached_at': '', 'volume_id': '8f5baaf7-e250-4292-9001-458dea30cda2', 'serial': '8f5baaf7-e250-4292-9001-458dea30cda2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '69a51f9a-e6ba-444e-b1c4-45119b851458', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:31:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDyahulx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:46 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:46 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:46 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace3732-8e9e-45b6-8006-46845b8fdc56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:46 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.utils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[698afaf8-a303-4a79-8bf5-5ea8d16cc289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5] added
Sep 04 23:31:46 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a71f9f-d5fe-4d55-abd4-7a7cd6d354ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3e0314-d8f9-45f6-9fc4-88af9c2d4564]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8b2d7-9aab-4e34-baf0-8dc055c7a346]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b453dad-f6ef-46ac-bff2-55ff3fe591cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eed087-34fe-41d6-900c-0ea6b4b73b16]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6293dd5-5ecb-4dbe-b6b6-11f466e62784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDyahulx {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDyahulx" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa695e9d-1ec0-4e74-a97f-946a59753bfd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RDyahulx'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:47 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5dc19c-4f43-4307-ae02-55e6bdc90ea2]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.utils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updating existing volume attachment record: 8763a370-b7cd-42e1-827a-2a95b7e4888e {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd085c2-e484-4db8-bdec-b093422811d8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74da32-bd50-4d6f-b5c2-2086226b5afd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fa054-ad09-477f-b917-6102040ae3c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260]
Sep 04 23:31:47 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8802bc5-e829-4da6-8e46-813e6555952d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56803495-24da-4535-b7e5-305a5445a2c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:47 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de313f3-4cc7-4e1a-a20f-2dbf4770aeae]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDyahulx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26637306663656266', 'path': '/dev/sdf'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637306663656266', 'path': '/dev/sdf'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyVvLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:48 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:48 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:48 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00310a4-8fe8-441a-a4e8-6cf97d0e68cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:48 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221d29b-f02e-4871-bfde-c86a95b99a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248] added
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[36814ecf-8285-4332-bf00-9a97b67861d9]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749e6c7-0ee4-4251-be1a-a88244fae1b0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyVvLxa {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGyVvLxa" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[131037e5-474d-4c16-ac61-0126cdbee34a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGyVvLxa'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d7dbd-7342-4780-a6d9-68bfc4679f2e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9869f799-5e2d-4826-8e1c-33fefc971f92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e375c-96df-4a66-a4d1-01dfb7183e00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260]
Sep 04 23:31:48 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eadbb1-ba82-4395-8a36-22f11b781d98]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dfec03-8415-45d1-8467-5908549a75c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54b6387-2345-44f5-a093-f0293f814499]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyVvLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23537653262656664', 'path': '/dev/sdg'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653262656664', 'path': '/dev/sdg'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FosdnNLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:49 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359fede-4d27-42f3-bb9b-e9b90c1be035]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:49 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32d379-cfed-40a2-8224-a029a0a8e827]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2] added
Sep 04 23:31:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3241e5-ff00-4847-ba43-083d88276210]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[623347ad-3d68-4cec-bafd-6ec17c39430d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FosdnNLR {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FosdnNLR" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5918a-1f36-4b5b-9202-9c61d9c4295e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FosdnNLR'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[631189d1-a9bb-48e4-b136-ef0778caa264]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.075s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a79c35-2336-4096-9032-d870283d32c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6a4bb-e2af-40f4-bd35-c18c844c6fe9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260]
Sep 04 23:31:50 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[33273596-da49-40af-8452-1eb01b3f983e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2951934d-24b4-40b7-839a-272d9cc11a04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c1bd7e-9478-456e-b370-bb3a8f73aefa]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FosdnNLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '26330666261353730', 'path': '/dev/sdh'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330666261353730', 'path': '/dev/sdh'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lazy-loading 'pci_devices' on Instance uuid 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:31:51 user nova-compute[72954]:   <uuid>2246c9a2-e6d8-4fd8-bc8b-49351a236b2f</uuid>
Sep 04 23:31:51 user nova-compute[72954]:   <name>instance-0000000c</name>
Sep 04 23:31:51 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:31:51 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:31:51 user nova-compute[72954]:   <metadata>
Sep 04 23:31:51 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:31:51 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:name>tempest-device-tagging-server-1671201946</nova:name>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:31:46</nova:creationTime>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:31:51 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:31:51 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:owner>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:user uuid="65a8dc3d341a4ed588888bc9fae5c824">tempest-TaggedBootDevicesTest_v242-1424111031-project-member</nova:user>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:project uuid="e6d70ab74f67414b912af732dc455009">tempest-TaggedBootDevicesTest_v242-1424111031</nova:project>
Sep 04 23:31:51 user nova-compute[72954]:       </nova:owner>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:31:51 user nova-compute[72954]:       <nova:ports>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="1cb4bc78-e278-4890-a436-2f18e71ce882">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.84" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="18691478-b154-41b4-b40c-6003fc6c4a6a">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.194" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="45a30df0-88bc-4290-87ea-cf1415155d71">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="190ad02b-b44c-4060-b923-46b101806751">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="2aa360bc-13ab-44ad-9d58-eb5171d0c5cf">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:         <nova:port uuid="c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf">
Sep 04 23:31:51 user nova-compute[72954]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Sep 04 23:31:51 user nova-compute[72954]:         </nova:port>
Sep 04 23:31:51 user nova-compute[72954]:       </nova:ports>
Sep 04 23:31:51 user nova-compute[72954]:     </nova:instance>
Sep 04 23:31:51 user nova-compute[72954]:   </metadata>
Sep 04 23:31:51 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:31:51 user nova-compute[72954]:     <system>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="serial">2246c9a2-e6d8-4fd8-bc8b-49351a236b2f</entry>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="uuid">2246c9a2-e6d8-4fd8-bc8b-49351a236b2f</entry>
Sep 04 23:31:51 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:31:51 user nova-compute[72954]:     </system>
Sep 04 23:31:51 user nova-compute[72954]:   </sysinfo>
Sep 04 23:31:51 user nova-compute[72954]:   <os>
Sep 04 23:31:51 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:31:51 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:31:51 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:31:51 user nova-compute[72954]:   </os>
Sep 04 23:31:51 user nova-compute[72954]:   <features>
Sep 04 23:31:51 user nova-compute[72954]:     <acpi/>
Sep 04 23:31:51 user nova-compute[72954]:     <apic/>
Sep 04 23:31:51 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:31:51 user nova-compute[72954]:   </features>
Sep 04 23:31:51 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:31:51 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:31:51 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:31:51 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:31:51 user nova-compute[72954]:   </clock>
Sep 04 23:31:51 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:31:51 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:31:51 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:31:51 user nova-compute[72954]:   </cpu>
Sep 04 23:31:51 user nova-compute[72954]:   <devices>
Sep 04 23:31:51 user nova-compute[72954]:     <disk type="file" device="cdrom">
Sep 04 23:31:51 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none"/>
Sep 04 23:31:51 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/disk.config"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="hda" bus="ide"/>
Sep 04 23:31:51 user nova-compute[72954]:     </disk>
Sep 04 23:31:51 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:51 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:51 user nova-compute[72954]:       <source dev="/dev/sdf"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <serial>89ee2fde-8c12-4f66-bbde-82e45d183ec5</serial>
Sep 04 23:31:51 user nova-compute[72954]:     </disk>
Sep 04 23:31:51 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:51 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:51 user nova-compute[72954]:       <source dev="/dev/sdg"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <serial>a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248</serial>
Sep 04 23:31:51 user nova-compute[72954]:     </disk>
Sep 04 23:31:51 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:31:51 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:51 user nova-compute[72954]:       <source dev="/dev/sdh"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="vdc" bus="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <serial>8f5baaf7-e250-4292-9001-458dea30cda2</serial>
Sep 04 23:31:51 user nova-compute[72954]:     </disk>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:78:ee:69"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tape008d5a5-4f"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:45:88:5e"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tap1cb4bc78-e2"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:4a:17:0b"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tap18691478-b1"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:86:d6:55"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tap45a30df0-88"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:fe:ca:2c"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tap190ad02b-b4"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:b3:6c:51"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tap2aa360bc-13"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:31:51 user nova-compute[72954]:       <mac address="fa:16:3e:df:08:54"/>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:31:51 user nova-compute[72954]:       <target dev="tapc806dbe0-d5"/>
Sep 04 23:31:51 user nova-compute[72954]:     </interface>
Sep 04 23:31:51 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:31:51 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/console.log" append="off"/>
Sep 04 23:31:51 user nova-compute[72954]:     </serial>
Sep 04 23:31:51 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:31:51 user nova-compute[72954]:     <video>
Sep 04 23:31:51 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:31:51 user nova-compute[72954]:     </video>
Sep 04 23:31:51 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:31:51 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:31:51 user nova-compute[72954]:     </rng>
Sep 04 23:31:51 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:31:51 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:31:51 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:31:51 user nova-compute[72954]:     </memballoon>
Sep 04 23:31:51 user nova-compute[72954]:   </devices>
Sep 04 23:31:51 user nova-compute[72954]: </domain>
Sep 04 23:31:51 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape008d5a5-4f, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape008d5a5-4f, col_values=(('external_ids', {'iface-id': 'e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:ee:69', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb4bc78-e2, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cb4bc78-e2, col_values=(('external_ids', {'iface-id': '1cb4bc78-e278-4890-a436-2f18e71ce882', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:88:5e', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18691478-b1, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18691478-b1, col_values=(('external_ids', {'iface-id': '18691478-b154-41b4-b40c-6003fc6c4a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:17:0b', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45a30df0-88, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45a30df0-88, col_values=(('external_ids', {'iface-id': '45a30df0-88bc-4290-87ea-cf1415155d71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:d6:55', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap190ad02b-b4, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap190ad02b-b4, col_values=(('external_ids', {'iface-id': '190ad02b-b44c-4060-b923-46b101806751', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ca:2c', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aa360bc-13, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2aa360bc-13, col_values=(('external_ids', {'iface-id': '2aa360bc-13ab-44ad-9d58-eb5171d0c5cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:6c:51', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc806dbe0-d5, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc806dbe0-d5, col_values=(('external_ids', {'iface-id': 'c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:08:54', 'vm-uuid': '2246c9a2-e6d8-4fd8-bc8b-49351a236b2f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:51 user nova-compute[72954]: INFO os_vif [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5')
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] No BDM found with device name hda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] No VIF found with MAC fa:16:3e:78:ee:69, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] No VIF found with MAC fa:16:3e:fe:ca:2c, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Using config drive
Sep 04 23:31:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Creating config drive at /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/disk.config
Sep 04 23:31:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdneyoplc {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdneyoplc" returned: 0 in 0.070s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:53 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:53 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:53 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a1fcda-3bcb-466c-ab7a-c5d699f11a69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:31:53 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f37777-27bd-4e3a-bd75-0d44ba576d11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db] added
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[526403b4-b2bb-40b4-b17b-2d21a3f51542]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0900f0-67d5-46c2-a887-ab767fd6f8ca]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhyNrRim {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhyNrRim" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ea399-759b-4331-9a1e-8b8cd9fbe0a5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DhyNrRim'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[34836c0c-96fd-4568-b8f1-5779b0e9d5fd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70b916-db01-4ebb-a144-9c70e6668566]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0683aa-ddda-461a-9f9c-ae6344968471]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]
Sep 04 23:31:53 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[640514cc-7471-4e20-beb0-8d0f9f1ecb5b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded342b-bf1a-4e58-9049-934fcb7113db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:53 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:31:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73cb7b1-c3b4-48da-b408-7deedec28e4d]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:31:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:54 user nova-compute[72954]: WARNING nova.compute.manager [req-c5ab4b87-7acc-42ef-93aa-b1412bb1bb66 req-8daa70e2-fa92-4332-9329-b54a2364a7d2 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b for instance with vm_state building and task_state spawning.
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lazy-loading 'flavor' on Instance uuid 016c702e-e3f2-416d-8faa-164bb25eabdc {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:54 user nova-compute[72954]: INFO nova.compute.manager [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Attaching volume 9c221f49-b50b-4ca1-be78-29cf43e96a30 to /dev/sdc
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.utils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4e7af-ad45-4747-bccd-795644ed84ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:54 user nova-compute[72954]: INFO nova.compute.manager [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Detaching volume ba6ee640-c74c-4ae7-b720-44d17d47632d
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c00f663-2baa-4eba-baa4-025e3c24fefe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4154e-baf5-4db2-bbe4-866cb060e1a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3834b1f-6423-498c-9254-5ede1b3e6d9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: INFO nova.virt.block_device [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Attempting to driver detach volume ba6ee640-c74c-4ae7-b720-44d17d47632d from mountpoint /dev/vdb
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:31:54 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:31:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75aa6a0-bea4-448a-a618-41a246a9bebc]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG os_brick.utils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updating existing volume attachment record: a213de9f-425d-4fb9-bf88-d43f2c45eaae {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Attempting to detach device vdb from instance 625f0d50-b25e-4542-863a-a65a8be8148d from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:31:54 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:54 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:31:54 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:31:54 user nova-compute[72954]:   <serial>ba6ee640-c74c-4ae7-b720-44d17d47632d</serial>
Sep 04 23:31:54 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:31:54 user nova-compute[72954]: </disk>
Sep 04 23:31:54 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:31:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully detached device vdb from instance 625f0d50-b25e-4542-863a-a65a8be8148d from the persistent domain config.
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 625f0d50-b25e-4542-863a-a65a8be8148d from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:31:54 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:54 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:31:54 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:31:54 user nova-compute[72954]:   <serial>ba6ee640-c74c-4ae7-b720-44d17d47632d</serial>
Sep 04 23:31:54 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:31:54 user nova-compute[72954]: </disk>
Sep 04 23:31:54 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23730373138626465', 'path': '/dev/sdi'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373138626465', 'path': '/dev/sdi'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lazy-loading 'flavor' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:31:55 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:31:55 user nova-compute[72954]:   <source dev="/dev/sdi"/>
Sep 04 23:31:55 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:31:55 user nova-compute[72954]:   <serial>390c94ba-aa06-42ad-adbb-cc7169c7d2db</serial>
Sep 04 23:31:55 user nova-compute[72954]: </disk>
Sep 04 23:31:55 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:55 user nova-compute[72954]: WARNING nova.compute.manager [req-9d905be9-866e-4f7b-b870-ade92a657d03 req-fd6589ea-4d96-4777-997b-b82adbb7b2c7 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 for instance with vm_state building and task_state spawning.
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870315.5088973, 625f0d50-b25e-4542-863a-a65a8be8148d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:31:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully detached device vdb from instance 625f0d50-b25e-4542-863a-a65a8be8148d from the live domain config.
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnmOlaMV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:31:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[46906467-c927-41c1-bc1c-b1e804963ed7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7533a2e4-4085-40ee-85ae-e047c4d12a29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:31:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:31:55 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:31:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1380b23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b52bb3c-34ff-4d3d-826d-c8e2dcf876ee]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c4a37-0792-48b0-b59f-f872f1d85c8a]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0503ae86-07a8-481d-b706-8b23724bb3d1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8319d-9c99-4695-a776-5f0b68326598]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4426b-5644-410d-987c-d39d29c3d8e0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c66ba1-dc9c-4a0c-b41e-a08af7018279]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260]
Sep 04 23:31:55 user nova-compute[72954]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d, portal: 172.16.0.220,3260] successful.
Sep 04 23:31:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c84cb-8c60-4556-b5b9-33c4a92edba4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] <== disconnect_volume: return (407ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:31:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:56 user nova-compute[72954]: WARNING nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b for instance with vm_state building and task_state spawning.
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:56 user nova-compute[72954]: WARNING nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 for instance with vm_state building and task_state spawning.
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:56 user nova-compute[72954]: WARNING nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 for instance with vm_state building and task_state spawning.
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:56 user nova-compute[72954]: WARNING nova.compute.manager [req-bb9c863f-684f-473e-b38c-f68768262639 req-349f09da-4d05-4aef-b566-44bb26d4ae3f service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a for instance with vm_state building and task_state spawning.
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] No VIF found with MAC fa:16:3e:80:80:b1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:57 user nova-compute[72954]: WARNING nova.compute.manager [req-ced0b044-360a-48ef-9513-8621f5564f2a req-06365dac-0a74-4969-a4b6-27cafa469338 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf for instance with vm_state building and task_state spawning.
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:57 user nova-compute[72954]: WARNING nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 for instance with vm_state building and task_state spawning.
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:57 user nova-compute[72954]: WARNING nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf for instance with vm_state building and task_state spawning.
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:57 user nova-compute[72954]: WARNING nova.compute.manager [req-5bba4e56-e71b-435f-8f7c-b275a0fe0484 req-c1aaa20c-5502-4866-9aa8-b54e660b7552 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf for instance with vm_state building and task_state spawning.
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:58 user nova-compute[72954]: WARNING nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a for instance with vm_state building and task_state spawning.
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:58 user nova-compute[72954]: WARNING nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 for instance with vm_state building and task_state spawning.
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:58 user nova-compute[72954]: WARNING nova.compute.manager [req-df3997bd-52c7-4bea-95be-97205b5ba2b3 req-66baaa66-9460-425a-bd90-413043f1e476 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 for instance with vm_state building and task_state spawning.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:31:59 user nova-compute[72954]: WARNING nova.compute.manager [req-845274a3-9fbb-4f4f-8276-2009f5857f95 req-7e8246d2-c52f-4a04-afa4-a69a5e12a9c8 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf for instance with vm_state building and task_state spawning.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870319.4420722, 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] VM Resumed (Lifecycle Event)
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance spawned successfully.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870319.4451773, 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] VM Started (Lifecycle Event)
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Took 13.00 seconds to spawn the instance on the hypervisor.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:31:59 user nova-compute[72954]: INFO nova.compute.manager [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Took 66.20 seconds to build instance.
Sep 04 23:31:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f005265-58c4-4bef-ae47-798f800266b0 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 66.304s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:03 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:04 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aezFJEvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:05 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb11f1-76fe-4c61-b9ee-98c7e2c2e5d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:32:05 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df3fde-90af-4e16-83d1-8ae589b2d8cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91] added
Sep 04 23:32:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec43b2e-0d81-4d5d-9880-d5a11c529264]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3c250-45a4-49b0-b3cd-63ec36079e39]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aezFJEvL {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aezFJEvL" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86120eb-58cc-4b72-bd2d-ee4bf15d0c38]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aezFJEvL'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f681210-4f4c-4d6c-a632-18fe7de6ad45]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b07c05-142b-4260-9832-cb53e61a13fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:05 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece1316-7508-484f-b1d9-928279a52b83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260]
Sep 04 23:32:05 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2fa3f3-45d0-48f0-ab13-12cdd1a15d8e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb830d-5617-42f5-b87c-311c59634797]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:06 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:06 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:06 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f661611-3fa1-497b-9e73-864528e466de]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aezFJEvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'flavor' on Instance uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc980734-3465-4526-b06b-1c9224fe0243 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 12.165s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-86544433-d800-4ac0-9aec-e01ecff10600 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.201s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.volume.cinder [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Update attachment failed for attachment a213de9f-425d-4fb9-bf88-d43f2c45eaae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75)
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Failed to attach 9c221f49-b50b-4ca1-be78-29cf43e96a30 at /dev/sdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Traceback (most recent call last):
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in _attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     bdm.attach(context, instance, self.volume_api, self.driver,
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     ret_val = method(obj, context, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     self._do_attach(context, instance, volume, volume_api,
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     self._volume_attach(context, volume, connector, instance,
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     connection_info = volume_api.attachment_update(
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     res = method(self, ctx, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     context, '3.44', skip_version_check=True).attachments.update(
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     return method.func(obj, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     resp = self._update('/attachments/%s' % id, body)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     return self._cs_request(url, 'PUT', **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     return self.request(url, method, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc]     raise exceptions.from_response(resp, body)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75)
Sep 04 23:32:07 user nova-compute[72954]: ERROR nova.compute.manager [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] 
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '23865636535343833', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865636535343833', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.objects.instance [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lazy-loading 'flavor' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.871s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] attach device xml: <disk type="block" device="disk">
Sep 04 23:32:07 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:07 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:32:07 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:07 user nova-compute[72954]:   <serial>0b6f82f4-b342-4325-88ec-8827e63cbf91</serial>
Sep 04 23:32:07 user nova-compute[72954]: </disk>
Sep 04 23:32:07 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server [None req-14cd7169-3b1d-43f6-bec7-3206b9338b1e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7536, in attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7533, in do_attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7531, in do_attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in _attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in _attach_volume
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9c221f49-b50b-4ca1-be78-29cf43e96a30/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:ba6ee640-c74c-4ae7-b720-44d17d47632d was not found.).). (HTTP 500) (Request-ID: req-ccbb0433-7c82-49c0-8ce9-ae342efe1e75)
Sep 04 23:32:07 user nova-compute[72954]: ERROR oslo_messaging.rpc.server 
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeAGulti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:07 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:07 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:07 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd6a3c9-2f21-4ee3-a485-dc1726d13a9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:32:07 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc944dd-2dfd-4c9d-a9bb-c73f630c236b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938] added
Sep 04 23:32:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48775a8-7c3e-43e4-994a-7747076cacbb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6792d85-20c9-4c23-ad67-c01a20186584]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeAGulti {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeAGulti" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49164e-7983-4558-81a6-9ba8c0ce148b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeAGulti'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe814d-4a8b-43f8-9202-edbf1d5a4bc8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.utils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] No VIF found with MAC fa:16:3e:cd:c4:1f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0d579-d5d8-449d-a8dc-6700fd679a66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba5d9ad-232d-4130-99b0-b8c331cdcaec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:07 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0abd8e0-664a-4d77-9c3c-21335a80d471]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[339fa605-f5dc-4f21-91fd-587c324fcf58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[33693754-e6ac-4591-a516-1b25fc748db5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefee289-a5d4-4063-b27c-83a6dc08f945]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260]
Sep 04 23:32:08 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:08 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11e1b6-eb0c-49ec-ade6-8010fec80e3c]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.utils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd34d79-913e-4085-b9e5-8b40bd8acd33]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-42685dcf-e17c-4d6a-a9c3-6a0550afc181 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.547s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21844fec-ece0-4029-b082-afba69672e0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:08 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.558s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04f40a-427b-4af1-8aa3-89d4f5b94f1e]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeAGulti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:32:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Swapping volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db for de00c290-9901-4a07-a36b-3c72efad00f2
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] volume_snapshot_create: create_info: {'snapshot_id': 'eb7ae93b-c13a-4bcd-9f50-38377daf21df', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72954) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] snap xml: <domainsnapshot>
Sep 04 23:32:08 user nova-compute[72954]:   <disks>
Sep 04 23:32:08 user nova-compute[72954]:     <disk name="/dev/sde" snapshot="external" type="file">
Sep 04 23:32:08 user nova-compute[72954]:       <source file="/dev/new_file"/>
Sep 04 23:32:08 user nova-compute[72954]:     </disk>
Sep 04 23:32:08 user nova-compute[72954]:     <disk name="vda" snapshot="no"/>
Sep 04 23:32:08 user nova-compute[72954]:   </disks>
Sep 04 23:32:08 user nova-compute[72954]: </domainsnapshot>
Sep 04 23:32:08 user nova-compute[72954]:  {{(pid=72954) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.objects.instance [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] Lazy-loading 'system_metadata' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Skipping quiescing instance: QEMU guest agent is not enabled.
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4277ddc6-85fc-4fb7-9950-3cc80a920454 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] volume_snapshot_delete: delete_info: {'volume_id': '0b6f82f4-b342-4325-88ec-8827e63cbf91'} {{(pid=72954) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [None req-4277ddc6-85fc-4fb7-9950-3cc80a920454 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     self._volume_snapshot_delete(context, instance, volume_id,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     if delete_info['type'] != 'qcow2':
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] KeyError: 'type'
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] 
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     rv = execute(f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     six.reraise(c, e, tb)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     raise value
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     rv = meth(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     self._volume_snapshot_create(context, instance, guest,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     rv = execute(f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     six.reraise(c, e, tb)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     raise value
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     rv = meth(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [instance: ffeb12e3-6924-4536-9d90-23064511fee8] 
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [None req-4277ddc6-85fc-4fb7-9950-3cc80a920454 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-31da7b1a-4fc9-47c8-8c4c-2a7980d9f5ea)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot eb7ae93b-c13a-4bcd-9f50-38377daf21df could not be found.
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise value
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot eb7ae93b-c13a-4bcd-9f50-38377daf21df could not be found. (HTTP 404) (Request-ID: req-edbeee73-5c42-46f1-9325-a3c507b0eda5)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot eb7ae93b-c13a-4bcd-9f50-38377daf21df could not be found.
Sep 04 23:32:08 user nova-compute[72954]: ERROR nova.virt.libvirt.driver 
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server [None req-4277ddc6-85fc-4fb7-9950-3cc80a920454 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] Exception during message handling: KeyError: 'type'
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4500, in volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server 
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server [None req-6df8a3c4-1870-4d6f-a073-439f807facd0 tempest-VolumesAssistedSnapshotsTest-421649761 tempest-VolumesAssistedSnapshotsTest-421649761-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4488, in volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise self.value
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise value
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Sep 04 23:32:08 user nova-compute[72954]: ERROR oslo_messaging.rpc.server 
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Detaching volume 0b6f82f4-b342-4325-88ec-8827e63cbf91
Sep 04 23:32:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:09 user nova-compute[72954]: INFO nova.virt.block_device [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Attempting to driver detach volume 0b6f82f4-b342-4325-88ec-8827e63cbf91 from mountpoint /dev/vdb
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Attempting to detach device vdb from instance ffeb12e3-6924-4536-9d90-23064511fee8 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:09 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:09 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:32:09 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:09 user nova-compute[72954]:   <serial>0b6f82f4-b342-4325-88ec-8827e63cbf91</serial>
Sep 04 23:32:09 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:32:09 user nova-compute[72954]: </disk>
Sep 04 23:32:09 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Successfully detached device vdb from instance ffeb12e3-6924-4536-9d90-23064511fee8 from the persistent domain config.
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffeb12e3-6924-4536-9d90-23064511fee8 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:09 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:09 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:32:09 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:09 user nova-compute[72954]:   <serial>0b6f82f4-b342-4325-88ec-8827e63cbf91</serial>
Sep 04 23:32:09 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:32:09 user nova-compute[72954]: </disk>
Sep 04 23:32:09 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.639s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] <== connect_volume: return (1641ms) {'type': 'block', 'scsi_wwn': '26531623765623738', 'path': '/dev/sdj'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531623765623738', 'path': '/dev/sdj'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.objects.instance [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:32:09 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:09 user nova-compute[72954]:   <source dev="/dev/sdj"/>
Sep 04 23:32:09 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:09 user nova-compute[72954]:   <serial>1996cea2-2cf9-40e0-b898-4bccb9831938</serial>
Sep 04 23:32:09 user nova-compute[72954]: </disk>
Sep 04 23:32:09 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:32:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870329.6045527, ffeb12e3-6924-4536-9d90-23064511fee8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:32:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Successfully detached device vdb from instance ffeb12e3-6924-4536-9d90-23064511fee8 from the live domain config.
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aezFJEvL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:10 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=6763MB free_disk=25.38534164428711GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb49670-a160-4830-b463-5d5280cdc945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No BDM found with device name hda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] No VIF found with MAC fa:16:3e:a2:3d:13, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b63946-acb2-4550-be60-50f6f22e27de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:10 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1184cfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d291ab-08fc-4e12-816c-1cc4c18d5661]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d67179-3381-46f1-8bc2-1a607f1815b4]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71e202a-98d6-409b-b6d2-64ec97bdeb96]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ffeb12e3-6924-4536-9d90-23064511fee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 621de8a1-f2a6-4337-a53e-6667555c8532 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 59f79766-4fb0-43e2-9f3e-9eed3d9129bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca8922-d57f-430b-b014-24fba3546ea2]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-056a074c-cea4-4173-be8f-06d7886a3c8b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.531s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc90db-9961-4147-a2c5-29d62a5a6ca2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[79336423-e20b-4f4e-a5b2-5db67ab69ad0]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260]
Sep 04 23:32:10 user nova-compute[72954]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b6f82f4-b342-4325-88ec-8827e63cbf91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf90803e-3377-4320-8a84-95910da54844]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] <== disconnect_volume: return (391ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:32:11 user nova-compute[72954]: INFO nova.compute.claims [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Claim successful on node user
Sep 04 23:32:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lazy-loading 'flavor' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9536bebb-d887-4266-b10c-90e275d4f487 tempest-VolumesAssistedSnapshotsTest-701114599 tempest-VolumesAssistedSnapshotsTest-701114599-project-admin] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.819s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.compute.manager [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Detaching volume 1996cea2-2cf9-40e0-b898-4bccb9831938
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.virt.block_device [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Attempting to driver detach volume 1996cea2-2cf9-40e0-b898-4bccb9831938 from mountpoint /dev/vdb
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Attempting to detach device vdb from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:12 user nova-compute[72954]:   <source dev="/dev/sdj"/>
Sep 04 23:32:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:12 user nova-compute[72954]:   <serial>1996cea2-2cf9-40e0-b898-4bccb9831938</serial>
Sep 04 23:32:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:32:12 user nova-compute[72954]: </disk>
Sep 04 23:32:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully detached device vdb from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the persistent domain config.
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:12 user nova-compute[72954]:   <source dev="/dev/sdj"/>
Sep 04 23:32:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:12 user nova-compute[72954]:   <serial>1996cea2-2cf9-40e0-b898-4bccb9831938</serial>
Sep 04 23:32:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:32:12 user nova-compute[72954]: </disk>
Sep 04 23:32:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.policy [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90f45a06454ddaa392e6cbfe58eeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4c625d90e54690b8cbb9d0c4cd6e54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.virt.block_device [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Booting with blank volume at /dev/vda
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870332.9157693, 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:32:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully detached device vdb from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the live domain config.
Sep 04 23:32:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeAGulti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:12 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10bdbf-71aa-4e15-8730-73e162b88219]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[944af873-380b-4393-9406-a4766ce0ff1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:12 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:12 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:13 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130388280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938'): ({'sdj'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Removing single pathed devices sdj {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f63095-614d-4ed4-9f9f-123e1cef9917]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.095s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d27a67f-88b5-4ce2-a2d4-3543e9a5f408]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Flushing IO for device /dev/sdj {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e8416-75a6-4918-8867-f08adddbdaa3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c149aee9-6564-4807-99c1-b9d89c15e28d]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] SCSI volumes sdj have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12d6137-a310-4b17-be03-303c4a23e14a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc382bd-ab51-42cc-888c-e504366948e1]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260]
Sep 04 23:32:13 user nova-compute[72954]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1996cea2-2cf9-40e0-b898-4bccb9831938 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[591270aa-939d-488e-b3e6-4882f68bcd76]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] <== disconnect_volume: return (429ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:32:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Successfully created port: 9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Successfully updated port: 9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-changed-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Refreshing instance network info cache due to event network-changed-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] Acquiring lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance network_info: |[{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] Acquired lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:14 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Refreshing network info cache for port 9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:32:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updated VIF entry in instance network info cache for port 9dc15794-54ed-4c11-a4d7-76c4c3f2b92c. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:32:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d4ff974-79cd-48b1-9bcb-905c9b38cb7b req-bb97f617-051f-46a7-8939-3f281e333776 service nova] Releasing lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.utils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[717fff23-dd65-4eb7-ba88-cc315d0b5446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12764f-75cd-448b-82a0-91345e7982c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c9712d-15cb-4d5a-be80-c12ccba00552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b5158b-0dbd-4a8f-a955-201fc27000f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:18 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7049b512-c70c-4b08-acfa-887fe21125d0]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG os_brick.utils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating existing volume attachment record: cff98b9e-0979-47ac-af48-50e61b1481f6 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d6c773-9f29-4249-a350-ba6cd5e25775 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.493s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-6249745d-a6db-4a0d-bcc1-eaed651cb1e1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-6249745d-a6db-4a0d-bcc1-eaed651cb1e1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Attempting to detach device tap6249745d-a6 from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] detach device xml: <interface type="ethernet">
Sep 04 23:32:18 user nova-compute[72954]:   <mac address="fa:16:3e:e0:4b:d8"/>
Sep 04 23:32:18 user nova-compute[72954]:   <model type="virtio"/>
Sep 04 23:32:18 user nova-compute[72954]:   <mtu size="1442"/>
Sep 04 23:32:18 user nova-compute[72954]:   <target dev="tap6249745d-a6"/>
Sep 04 23:32:18 user nova-compute[72954]: </interface>
Sep 04 23:32:18 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface>not found in domain: <domain type='kvm' id='9'>
Sep 04 23:32:18 user nova-compute[72954]:   <name>instance-00000009</name>
Sep 04 23:32:18 user nova-compute[72954]:   <uuid>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</uuid>
Sep 04 23:32:18 user nova-compute[72954]:   <metadata>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:18 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:31:43</nova:creationTime>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:18 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:18 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:18 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:18 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:18 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:18 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:18 user nova-compute[72954]:     <nova:port uuid="6249745d-a6db-4a0d-bcc1-eaed651cb1e1">
Sep 04 23:32:18 user nova-compute[72954]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Sep 04 23:32:18 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:18 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:18 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:18 user nova-compute[72954]:   </metadata>
Sep 04 23:32:18 user nova-compute[72954]:   <memory unit='KiB'>524288</memory>
Sep 04 23:32:18 user nova-compute[72954]:   <currentMemory unit='KiB'>524288</currentMemory>
Sep 04 23:32:18 user nova-compute[72954]:   <vcpu placement='static'>1</vcpu>
Sep 04 23:32:18 user nova-compute[72954]:   <resource>
Sep 04 23:32:18 user nova-compute[72954]:     <partition>/machine</partition>
Sep 04 23:32:18 user nova-compute[72954]:   </resource>
Sep 04 23:32:18 user nova-compute[72954]:   <sysinfo type='smbios'>
Sep 04 23:32:18 user nova-compute[72954]:     <system>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='product'>OpenStack Nova</entry>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='version'>0.0.0</entry>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='serial'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='uuid'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:18 user nova-compute[72954]:       <entry name='family'>Virtual Machine</entry>
Sep 04 23:32:18 user nova-compute[72954]:     </system>
Sep 04 23:32:18 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:18 user nova-compute[72954]:   <os>
Sep 04 23:32:18 user nova-compute[72954]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Sep 04 23:32:18 user nova-compute[72954]:     <boot dev='hd'/>
Sep 04 23:32:18 user nova-compute[72954]:     <smbios mode='sysinfo'/>
Sep 04 23:32:18 user nova-compute[72954]:   </os>
Sep 04 23:32:18 user nova-compute[72954]:   <features>
Sep 04 23:32:18 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:18 user nova-compute[72954]:     <apic/>
Sep 04 23:32:18 user nova-compute[72954]:     <vmcoreinfo state='on'/>
Sep 04 23:32:18 user nova-compute[72954]:   </features>
Sep 04 23:32:18 user nova-compute[72954]:   <cpu mode='custom' match='exact' check='full'>
Sep 04 23:32:18 user nova-compute[72954]:     <model fallback='forbid'>Nehalem</model>
Sep 04 23:32:18 user nova-compute[72954]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Sep 04 23:32:18 user nova-compute[72954]:     <feature policy='require' name='vme'/>
Sep 04 23:32:18 user nova-compute[72954]:     <feature policy='require' name='x2apic'/>
Sep 04 23:32:18 user nova-compute[72954]:     <feature policy='require' name='hypervisor'/>
Sep 04 23:32:18 user nova-compute[72954]:   </cpu>
Sep 04 23:32:18 user nova-compute[72954]:   <clock offset='utc'>
Sep 04 23:32:18 user nova-compute[72954]:     <timer name='pit' tickpolicy='delay'/>
Sep 04 23:32:18 user nova-compute[72954]:     <timer name='rtc' tickpolicy='catchup'/>
Sep 04 23:32:18 user nova-compute[72954]:     <timer name='hpet' present='no'/>
Sep 04 23:32:18 user nova-compute[72954]:   </clock>
Sep 04 23:32:18 user nova-compute[72954]:   <on_poweroff>destroy</on_poweroff>
Sep 04 23:32:18 user nova-compute[72954]:   <on_reboot>restart</on_reboot>
Sep 04 23:32:18 user nova-compute[72954]:   <on_crash>destroy</on_crash>
Sep 04 23:32:18 user nova-compute[72954]:   <devices>
Sep 04 23:32:18 user nova-compute[72954]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Sep 04 23:32:18 user nova-compute[72954]:     <disk type='file' device='disk'>
Sep 04 23:32:18 user nova-compute[72954]:       <driver name='qemu' type='qcow2' cache='none'/>
Sep 04 23:32:18 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk' index='2'/>
Sep 04 23:32:18 user nova-compute[72954]:       <backingStore type='file' index='3'>
Sep 04 23:32:18 user nova-compute[72954]:         <format type='raw'/>
Sep 04 23:32:18 user nova-compute[72954]:         <source file='/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb'/>
Sep 04 23:32:18 user nova-compute[72954]:         <backingStore/>
Sep 04 23:32:18 user nova-compute[72954]:       </backingStore>
Sep 04 23:32:18 user nova-compute[72954]:       <target dev='vda' bus='virtio'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='virtio-disk0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </disk>
Sep 04 23:32:18 user nova-compute[72954]:     <disk type='file' device='cdrom'>
Sep 04 23:32:18 user nova-compute[72954]:       <driver name='qemu' type='raw' cache='none'/>
Sep 04 23:32:18 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config' index='1'/>
Sep 04 23:32:18 user nova-compute[72954]:       <backingStore/>
Sep 04 23:32:18 user nova-compute[72954]:       <target dev='hda' bus='ide'/>
Sep 04 23:32:18 user nova-compute[72954]:       <readonly/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='ide0-0-0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </disk>
Sep 04 23:32:18 user nova-compute[72954]:     <controller type='usb' index='0' model='none'>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='usb'/>
Sep 04 23:32:18 user nova-compute[72954]:     </controller>
Sep 04 23:32:18 user nova-compute[72954]:     <controller type='pci' index='0' model='pci-root'>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='pci.0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </controller>
Sep 04 23:32:18 user nova-compute[72954]:     <controller type='ide' index='0'>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='ide'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Sep 04 23:32:18 user nova-compute[72954]:     </controller>
Sep 04 23:32:18 user nova-compute[72954]:     <interface type='ethernet'>
Sep 04 23:32:18 user nova-compute[72954]:       <mac address='fa:16:3e:a2:3d:13'/>
Sep 04 23:32:18 user nova-compute[72954]:       <target dev='tap1d7af612-bd'/>
Sep 04 23:32:18 user nova-compute[72954]:       <model type='virtio'/>
Sep 04 23:32:18 user nova-compute[72954]:       <mtu size='1442'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='net0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </interface>
Sep 04 23:32:18 user nova-compute[72954]:     <interface type='ethernet'>
Sep 04 23:32:18 user nova-compute[72954]:       <mac address='fa:16:3e:e0:4b:d8'/>
Sep 04 23:32:18 user nova-compute[72954]:       <target dev='tap6249745d-a6'/>
Sep 04 23:32:18 user nova-compute[72954]:       <model type='virtio'/>
Sep 04 23:32:18 user nova-compute[72954]:       <mtu size='1442'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='net1'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </interface>
Sep 04 23:32:18 user nova-compute[72954]:     <serial type='pty'>
Sep 04 23:32:18 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:18 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:18 user nova-compute[72954]:       <target type='isa-serial' port='0'>
Sep 04 23:32:18 user nova-compute[72954]:         <model name='isa-serial'/>
Sep 04 23:32:18 user nova-compute[72954]:       </target>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </serial>
Sep 04 23:32:18 user nova-compute[72954]:     <console type='pty' tty='/dev/pts/7'>
Sep 04 23:32:18 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:18 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:18 user nova-compute[72954]:       <target type='serial' port='0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </console>
Sep 04 23:32:18 user nova-compute[72954]:     <input type='mouse' bus='ps2'>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='input0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </input>
Sep 04 23:32:18 user nova-compute[72954]:     <input type='keyboard' bus='ps2'>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='input1'/>
Sep 04 23:32:18 user nova-compute[72954]:     </input>
Sep 04 23:32:18 user nova-compute[72954]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Sep 04 23:32:18 user nova-compute[72954]:       <listen type='address' address='0.0.0.0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </graphics>
Sep 04 23:32:18 user nova-compute[72954]:     <audio id='1' type='none'/>
Sep 04 23:32:18 user nova-compute[72954]:     <video>
Sep 04 23:32:18 user nova-compute[72954]:       <model type='virtio' heads='1' primary='yes'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='video0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </video>
Sep 04 23:32:18 user nova-compute[72954]:     <memballoon model='virtio'>
Sep 04 23:32:18 user nova-compute[72954]:       <stats period='10'/>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='balloon0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:18 user nova-compute[72954]:     <rng model='virtio'>
Sep 04 23:32:18 user nova-compute[72954]:       <backend model='random'>/dev/urandom</backend>
Sep 04 23:32:18 user nova-compute[72954]:       <alias name='rng0'/>
Sep 04 23:32:18 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Sep 04 23:32:18 user nova-compute[72954]:     </rng>
Sep 04 23:32:18 user nova-compute[72954]:   </devices>
Sep 04 23:32:18 user nova-compute[72954]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Sep 04 23:32:18 user nova-compute[72954]:     <label>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</label>
Sep 04 23:32:18 user nova-compute[72954]:     <imagelabel>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</imagelabel>
Sep 04 23:32:18 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:18 user nova-compute[72954]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Sep 04 23:32:18 user nova-compute[72954]:     <label>+64055:+108</label>
Sep 04 23:32:18 user nova-compute[72954]:     <imagelabel>+64055:+108</imagelabel>
Sep 04 23:32:18 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:18 user nova-compute[72954]: </domain>
Sep 04 23:32:18 user nova-compute[72954]:  {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Sep 04 23:32:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully detached device tap6249745d-a6 from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the persistent domain config.
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] (1/8): Attempting to detach device tap6249745d-a6 with device alias net1 from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:32:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] detach device xml: <interface type="ethernet">
Sep 04 23:32:18 user nova-compute[72954]:   <mac address="fa:16:3e:e0:4b:d8"/>
Sep 04 23:32:18 user nova-compute[72954]:   <model type="virtio"/>
Sep 04 23:32:18 user nova-compute[72954]:   <mtu size="1442"/>
Sep 04 23:32:18 user nova-compute[72954]:   <target dev="tap6249745d-a6"/>
Sep 04 23:32:18 user nova-compute[72954]: </interface>
Sep 04 23:32:18 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870339.0900302, 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Start waiting for the detach event from libvirt for device tap6249745d-a6 with device alias net1 for instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface>not found in domain: <domain type='kvm' id='9'>
Sep 04 23:32:19 user nova-compute[72954]:   <name>instance-00000009</name>
Sep 04 23:32:19 user nova-compute[72954]:   <uuid>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</uuid>
Sep 04 23:32:19 user nova-compute[72954]:   <metadata>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:19 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:31:43</nova:creationTime>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:19 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="6249745d-a6db-4a0d-bcc1-eaed651cb1e1">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:19 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:19 user nova-compute[72954]:   </metadata>
Sep 04 23:32:19 user nova-compute[72954]:   <memory unit='KiB'>524288</memory>
Sep 04 23:32:19 user nova-compute[72954]:   <currentMemory unit='KiB'>524288</currentMemory>
Sep 04 23:32:19 user nova-compute[72954]:   <vcpu placement='static'>1</vcpu>
Sep 04 23:32:19 user nova-compute[72954]:   <resource>
Sep 04 23:32:19 user nova-compute[72954]:     <partition>/machine</partition>
Sep 04 23:32:19 user nova-compute[72954]:   </resource>
Sep 04 23:32:19 user nova-compute[72954]:   <sysinfo type='smbios'>
Sep 04 23:32:19 user nova-compute[72954]:     <system>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='product'>OpenStack Nova</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='version'>0.0.0</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='serial'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='uuid'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='family'>Virtual Machine</entry>
Sep 04 23:32:19 user nova-compute[72954]:     </system>
Sep 04 23:32:19 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:19 user nova-compute[72954]:   <os>
Sep 04 23:32:19 user nova-compute[72954]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Sep 04 23:32:19 user nova-compute[72954]:     <boot dev='hd'/>
Sep 04 23:32:19 user nova-compute[72954]:     <smbios mode='sysinfo'/>
Sep 04 23:32:19 user nova-compute[72954]:   </os>
Sep 04 23:32:19 user nova-compute[72954]:   <features>
Sep 04 23:32:19 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:19 user nova-compute[72954]:     <apic/>
Sep 04 23:32:19 user nova-compute[72954]:     <vmcoreinfo state='on'/>
Sep 04 23:32:19 user nova-compute[72954]:   </features>
Sep 04 23:32:19 user nova-compute[72954]:   <cpu mode='custom' match='exact' check='full'>
Sep 04 23:32:19 user nova-compute[72954]:     <model fallback='forbid'>Nehalem</model>
Sep 04 23:32:19 user nova-compute[72954]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='vme'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='x2apic'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='hypervisor'/>
Sep 04 23:32:19 user nova-compute[72954]:   </cpu>
Sep 04 23:32:19 user nova-compute[72954]:   <clock offset='utc'>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='pit' tickpolicy='delay'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='rtc' tickpolicy='catchup'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='hpet' present='no'/>
Sep 04 23:32:19 user nova-compute[72954]:   </clock>
Sep 04 23:32:19 user nova-compute[72954]:   <on_poweroff>destroy</on_poweroff>
Sep 04 23:32:19 user nova-compute[72954]:   <on_reboot>restart</on_reboot>
Sep 04 23:32:19 user nova-compute[72954]:   <on_crash>destroy</on_crash>
Sep 04 23:32:19 user nova-compute[72954]:   <devices>
Sep 04 23:32:19 user nova-compute[72954]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='disk'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='qcow2' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk' index='2'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore type='file' index='3'>
Sep 04 23:32:19 user nova-compute[72954]:         <format type='raw'/>
Sep 04 23:32:19 user nova-compute[72954]:         <source file='/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb'/>
Sep 04 23:32:19 user nova-compute[72954]:         <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       </backingStore>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='vda' bus='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='virtio-disk0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='cdrom'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='raw' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config' index='1'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='hda' bus='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <readonly/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide0-0-0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='usb' index='0' model='none'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='usb'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='pci' index='0' model='pci-root'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='pci.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='ide' index='0'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <interface type='ethernet'>
Sep 04 23:32:19 user nova-compute[72954]:       <mac address='fa:16:3e:a2:3d:13'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='tap1d7af612-bd'/>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <mtu size='1442'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='net0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </interface>
Sep 04 23:32:19 user nova-compute[72954]:     <serial type='pty'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='isa-serial' port='0'>
Sep 04 23:32:19 user nova-compute[72954]:         <model name='isa-serial'/>
Sep 04 23:32:19 user nova-compute[72954]:       </target>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </serial>
Sep 04 23:32:19 user nova-compute[72954]:     <console type='pty' tty='/dev/pts/7'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='serial' port='0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </console>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='mouse' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='keyboard' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Sep 04 23:32:19 user nova-compute[72954]:       <listen type='address' address='0.0.0.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </graphics>
Sep 04 23:32:19 user nova-compute[72954]:     <audio id='1' type='none'/>
Sep 04 23:32:19 user nova-compute[72954]:     <video>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio' heads='1' primary='yes'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='video0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </video>
Sep 04 23:32:19 user nova-compute[72954]:     <memballoon model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <stats period='10'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='balloon0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:19 user nova-compute[72954]:     <rng model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <backend model='random'>/dev/urandom</backend>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='rng0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </rng>
Sep 04 23:32:19 user nova-compute[72954]:   </devices>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>+64055:+108</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>+64055:+108</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]: </domain>
Sep 04 23:32:19 user nova-compute[72954]:  {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Sep 04 23:32:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully detached device tap6249745d-a6 from instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 from the live domain config.
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG os_vif [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6249745d-a6, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: INFO os_vif [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6')
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:19 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:32:19</nova:creationTime>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:19 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:19 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:19 user nova-compute[72954]:  {{(pid=72954) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-unplugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-unplugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:19 user nova-compute[72954]: WARNING nova.compute.manager [req-85b4bdd1-1a2a-46a2-b21b-2b7fee275b36 req-c232fb05-c5d2-49a0-bbfc-958ad70b9d5d service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-unplugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 for instance with vm_state active and task_state None.
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-deleted-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:19 user nova-compute[72954]: INFO nova.compute.manager [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Neutron deleted interface 6249745d-a6db-4a0d-bcc1-eaed651cb1e1; detaching it from the instance and deleting it from the info cache
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquired lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.objects.instance [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Lazy-loading 'system_metadata' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.objects.instance [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Lazy-loading 'flavor' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.objects.base [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Object Instance<6f2dd93c-0564-4e76-8219-a4e5a7aaace5> lazy-loaded attributes: system_metadata,flavor {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface>not found in domain: <domain type='kvm' id='9'>
Sep 04 23:32:19 user nova-compute[72954]:   <name>instance-00000009</name>
Sep 04 23:32:19 user nova-compute[72954]:   <uuid>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</uuid>
Sep 04 23:32:19 user nova-compute[72954]:   <metadata>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:19 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:32:19</nova:creationTime>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:19 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:19 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:19 user nova-compute[72954]:   </metadata>
Sep 04 23:32:19 user nova-compute[72954]:   <memory unit='KiB'>524288</memory>
Sep 04 23:32:19 user nova-compute[72954]:   <currentMemory unit='KiB'>524288</currentMemory>
Sep 04 23:32:19 user nova-compute[72954]:   <vcpu placement='static'>1</vcpu>
Sep 04 23:32:19 user nova-compute[72954]:   <resource>
Sep 04 23:32:19 user nova-compute[72954]:     <partition>/machine</partition>
Sep 04 23:32:19 user nova-compute[72954]:   </resource>
Sep 04 23:32:19 user nova-compute[72954]:   <sysinfo type='smbios'>
Sep 04 23:32:19 user nova-compute[72954]:     <system>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='product'>OpenStack Nova</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='version'>0.0.0</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='serial'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='uuid'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='family'>Virtual Machine</entry>
Sep 04 23:32:19 user nova-compute[72954]:     </system>
Sep 04 23:32:19 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:19 user nova-compute[72954]:   <os>
Sep 04 23:32:19 user nova-compute[72954]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Sep 04 23:32:19 user nova-compute[72954]:     <boot dev='hd'/>
Sep 04 23:32:19 user nova-compute[72954]:     <smbios mode='sysinfo'/>
Sep 04 23:32:19 user nova-compute[72954]:   </os>
Sep 04 23:32:19 user nova-compute[72954]:   <features>
Sep 04 23:32:19 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:19 user nova-compute[72954]:     <apic/>
Sep 04 23:32:19 user nova-compute[72954]:     <vmcoreinfo state='on'/>
Sep 04 23:32:19 user nova-compute[72954]:   </features>
Sep 04 23:32:19 user nova-compute[72954]:   <cpu mode='custom' match='exact' check='full'>
Sep 04 23:32:19 user nova-compute[72954]:     <model fallback='forbid'>Nehalem</model>
Sep 04 23:32:19 user nova-compute[72954]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='vme'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='x2apic'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='hypervisor'/>
Sep 04 23:32:19 user nova-compute[72954]:   </cpu>
Sep 04 23:32:19 user nova-compute[72954]:   <clock offset='utc'>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='pit' tickpolicy='delay'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='rtc' tickpolicy='catchup'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='hpet' present='no'/>
Sep 04 23:32:19 user nova-compute[72954]:   </clock>
Sep 04 23:32:19 user nova-compute[72954]:   <on_poweroff>destroy</on_poweroff>
Sep 04 23:32:19 user nova-compute[72954]:   <on_reboot>restart</on_reboot>
Sep 04 23:32:19 user nova-compute[72954]:   <on_crash>destroy</on_crash>
Sep 04 23:32:19 user nova-compute[72954]:   <devices>
Sep 04 23:32:19 user nova-compute[72954]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='disk'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='qcow2' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk' index='2'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore type='file' index='3'>
Sep 04 23:32:19 user nova-compute[72954]:         <format type='raw'/>
Sep 04 23:32:19 user nova-compute[72954]:         <source file='/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb'/>
Sep 04 23:32:19 user nova-compute[72954]:         <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       </backingStore>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='vda' bus='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='virtio-disk0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='cdrom'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='raw' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config' index='1'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='hda' bus='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <readonly/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide0-0-0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='usb' index='0' model='none'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='usb'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='pci' index='0' model='pci-root'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='pci.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='ide' index='0'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <interface type='ethernet'>
Sep 04 23:32:19 user nova-compute[72954]:       <mac address='fa:16:3e:a2:3d:13'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='tap1d7af612-bd'/>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <mtu size='1442'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='net0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </interface>
Sep 04 23:32:19 user nova-compute[72954]:     <serial type='pty'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='isa-serial' port='0'>
Sep 04 23:32:19 user nova-compute[72954]:         <model name='isa-serial'/>
Sep 04 23:32:19 user nova-compute[72954]:       </target>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </serial>
Sep 04 23:32:19 user nova-compute[72954]:     <console type='pty' tty='/dev/pts/7'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='serial' port='0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </console>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='mouse' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='keyboard' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Sep 04 23:32:19 user nova-compute[72954]:       <listen type='address' address='0.0.0.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </graphics>
Sep 04 23:32:19 user nova-compute[72954]:     <audio id='1' type='none'/>
Sep 04 23:32:19 user nova-compute[72954]:     <video>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio' heads='1' primary='yes'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='video0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </video>
Sep 04 23:32:19 user nova-compute[72954]:     <memballoon model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <stats period='10'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='balloon0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:19 user nova-compute[72954]:     <rng model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <backend model='random'>/dev/urandom</backend>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='rng0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </rng>
Sep 04 23:32:19 user nova-compute[72954]:   </devices>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>+64055:+108</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>+64055:+108</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]: </domain>
Sep 04 23:32:19 user nova-compute[72954]:  {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface> {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e0:4b:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tap6249745d-a6"/></interface>not found in domain: <domain type='kvm' id='9'>
Sep 04 23:32:19 user nova-compute[72954]:   <name>instance-00000009</name>
Sep 04 23:32:19 user nova-compute[72954]:   <uuid>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</uuid>
Sep 04 23:32:19 user nova-compute[72954]:   <metadata>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:19 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:32:19</nova:creationTime>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:19 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:19 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:19 user nova-compute[72954]:   </metadata>
Sep 04 23:32:19 user nova-compute[72954]:   <memory unit='KiB'>524288</memory>
Sep 04 23:32:19 user nova-compute[72954]:   <currentMemory unit='KiB'>524288</currentMemory>
Sep 04 23:32:19 user nova-compute[72954]:   <vcpu placement='static'>1</vcpu>
Sep 04 23:32:19 user nova-compute[72954]:   <resource>
Sep 04 23:32:19 user nova-compute[72954]:     <partition>/machine</partition>
Sep 04 23:32:19 user nova-compute[72954]:   </resource>
Sep 04 23:32:19 user nova-compute[72954]:   <sysinfo type='smbios'>
Sep 04 23:32:19 user nova-compute[72954]:     <system>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='product'>OpenStack Nova</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='version'>0.0.0</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='serial'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='uuid'>6f2dd93c-0564-4e76-8219-a4e5a7aaace5</entry>
Sep 04 23:32:19 user nova-compute[72954]:       <entry name='family'>Virtual Machine</entry>
Sep 04 23:32:19 user nova-compute[72954]:     </system>
Sep 04 23:32:19 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:19 user nova-compute[72954]:   <os>
Sep 04 23:32:19 user nova-compute[72954]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Sep 04 23:32:19 user nova-compute[72954]:     <boot dev='hd'/>
Sep 04 23:32:19 user nova-compute[72954]:     <smbios mode='sysinfo'/>
Sep 04 23:32:19 user nova-compute[72954]:   </os>
Sep 04 23:32:19 user nova-compute[72954]:   <features>
Sep 04 23:32:19 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:19 user nova-compute[72954]:     <apic/>
Sep 04 23:32:19 user nova-compute[72954]:     <vmcoreinfo state='on'/>
Sep 04 23:32:19 user nova-compute[72954]:   </features>
Sep 04 23:32:19 user nova-compute[72954]:   <cpu mode='custom' match='exact' check='full'>
Sep 04 23:32:19 user nova-compute[72954]:     <model fallback='forbid'>Nehalem</model>
Sep 04 23:32:19 user nova-compute[72954]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='vme'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='x2apic'/>
Sep 04 23:32:19 user nova-compute[72954]:     <feature policy='require' name='hypervisor'/>
Sep 04 23:32:19 user nova-compute[72954]:   </cpu>
Sep 04 23:32:19 user nova-compute[72954]:   <clock offset='utc'>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='pit' tickpolicy='delay'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='rtc' tickpolicy='catchup'/>
Sep 04 23:32:19 user nova-compute[72954]:     <timer name='hpet' present='no'/>
Sep 04 23:32:19 user nova-compute[72954]:   </clock>
Sep 04 23:32:19 user nova-compute[72954]:   <on_poweroff>destroy</on_poweroff>
Sep 04 23:32:19 user nova-compute[72954]:   <on_reboot>restart</on_reboot>
Sep 04 23:32:19 user nova-compute[72954]:   <on_crash>destroy</on_crash>
Sep 04 23:32:19 user nova-compute[72954]:   <devices>
Sep 04 23:32:19 user nova-compute[72954]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='disk'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='qcow2' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk' index='2'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore type='file' index='3'>
Sep 04 23:32:19 user nova-compute[72954]:         <format type='raw'/>
Sep 04 23:32:19 user nova-compute[72954]:         <source file='/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb'/>
Sep 04 23:32:19 user nova-compute[72954]:         <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       </backingStore>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='vda' bus='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='virtio-disk0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <disk type='file' device='cdrom'>
Sep 04 23:32:19 user nova-compute[72954]:       <driver name='qemu' type='raw' cache='none'/>
Sep 04 23:32:19 user nova-compute[72954]:       <source file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk.config' index='1'/>
Sep 04 23:32:19 user nova-compute[72954]:       <backingStore/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='hda' bus='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <readonly/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide0-0-0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </disk>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='usb' index='0' model='none'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='usb'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='pci' index='0' model='pci-root'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='pci.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <controller type='ide' index='0'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='ide'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </controller>
Sep 04 23:32:19 user nova-compute[72954]:     <interface type='ethernet'>
Sep 04 23:32:19 user nova-compute[72954]:       <mac address='fa:16:3e:a2:3d:13'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target dev='tap1d7af612-bd'/>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio'/>
Sep 04 23:32:19 user nova-compute[72954]:       <mtu size='1442'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='net0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </interface>
Sep 04 23:32:19 user nova-compute[72954]:     <serial type='pty'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='isa-serial' port='0'>
Sep 04 23:32:19 user nova-compute[72954]:         <model name='isa-serial'/>
Sep 04 23:32:19 user nova-compute[72954]:       </target>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </serial>
Sep 04 23:32:19 user nova-compute[72954]:     <console type='pty' tty='/dev/pts/7'>
Sep 04 23:32:19 user nova-compute[72954]:       <source path='/dev/pts/7'/>
Sep 04 23:32:19 user nova-compute[72954]:       <log file='/opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/console.log' append='off'/>
Sep 04 23:32:19 user nova-compute[72954]:       <target type='serial' port='0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='serial0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </console>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='mouse' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <input type='keyboard' bus='ps2'>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='input1'/>
Sep 04 23:32:19 user nova-compute[72954]:     </input>
Sep 04 23:32:19 user nova-compute[72954]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Sep 04 23:32:19 user nova-compute[72954]:       <listen type='address' address='0.0.0.0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </graphics>
Sep 04 23:32:19 user nova-compute[72954]:     <audio id='1' type='none'/>
Sep 04 23:32:19 user nova-compute[72954]:     <video>
Sep 04 23:32:19 user nova-compute[72954]:       <model type='virtio' heads='1' primary='yes'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='video0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </video>
Sep 04 23:32:19 user nova-compute[72954]:     <memballoon model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <stats period='10'/>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='balloon0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:19 user nova-compute[72954]:     <rng model='virtio'>
Sep 04 23:32:19 user nova-compute[72954]:       <backend model='random'>/dev/urandom</backend>
Sep 04 23:32:19 user nova-compute[72954]:       <alias name='rng0'/>
Sep 04 23:32:19 user nova-compute[72954]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Sep 04 23:32:19 user nova-compute[72954]:     </rng>
Sep 04 23:32:19 user nova-compute[72954]:   </devices>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>libvirt-6f2dd93c-0564-4e76-8219-a4e5a7aaace5</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Sep 04 23:32:19 user nova-compute[72954]:     <label>+64055:+108</label>
Sep 04 23:32:19 user nova-compute[72954]:     <imagelabel>+64055:+108</imagelabel>
Sep 04 23:32:19 user nova-compute[72954]:   </seclabel>
Sep 04 23:32:19 user nova-compute[72954]: </domain>
Sep 04 23:32:19 user nova-compute[72954]:  {{(pid=72954) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Sep 04 23:32:19 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Detaching interface fa:16:3e:e0:4b:d8 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap6249745d-a6' not found.
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Converting VIF {"id": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "address": "fa:16:3e:e0:4b:d8", "network": {"id": "a2844204-8100-4f5f-b0e0-fb7ad3f279e6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1546742798", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6249745d-a6", "ovs_interfaceid": "6249745d-a6db-4a0d-bcc1-eaed651cb1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG os_vif [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6249745d-a6, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:32:19 user nova-compute[72954]: INFO os_vif [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4b:d8,bridge_name='br-int',has_traffic_filtering=True,id=6249745d-a6db-4a0d-bcc1-eaed651cb1e1,network=Network(a2844204-8100-4f5f-b0e0-fb7ad3f279e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6249745d-a6')
Sep 04 23:32:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [req-71b0ddc5-c5ef-4b04-95ba-6cc8ba08b612 req-744fadf9-2993-411a-a522-8fd84e71e575 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:19 user nova-compute[72954]:   <nova:package version="0.0.0"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:name>tempest-device-tagging-server-1212774869</nova:name>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:creationTime>2023-09-04 23:32:19</nova:creationTime>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:flavor name="m1.tiny">
Sep 04 23:32:19 user nova-compute[72954]:     <nova:memory>512</nova:memory>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:disk>1</nova:disk>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:swap>0</nova:swap>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:flavor>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:user uuid="b7cb888448fb4c389096c8be0e881847">tempest-TaggedAttachmentsTest-669860998-project-member</nova:user>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:project uuid="ed713e4a84fe4a8eb43e342c36a2f860">tempest-TaggedAttachmentsTest-669860998</nova:project>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:owner>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:19 user nova-compute[72954]:   <nova:ports>
Sep 04 23:32:19 user nova-compute[72954]:     <nova:port uuid="1d7af612-bd03-4234-b329-92603ec8e2ce">
Sep 04 23:32:19 user nova-compute[72954]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:32:19 user nova-compute[72954]:     </nova:port>
Sep 04 23:32:19 user nova-compute[72954]:   </nova:ports>
Sep 04 23:32:19 user nova-compute[72954]: </nova:instance>
Sep 04 23:32:19 user nova-compute[72954]:  {{(pid=72954) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Sep 04 23:32:20 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [{"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Releasing lock "refresh_cache-6f2dd93c-0564-4e76-8219-a4e5a7aaace5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ea17a111-79f1-411c-9e9d-600bfe20c70b tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "interface-6f2dd93c-0564-4e76-8219-a4e5a7aaace5-6249745d-a6db-4a0d-bcc1-eaed651cb1e1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.459s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:21 user nova-compute[72954]: WARNING nova.compute.manager [req-2641001e-a6f3-4903-ba79-eb224fadbf61 req-40bf6bb3-26bc-4c0f-b1f3-4fe4d824ccb0 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-6249745d-a6db-4a0d-bcc1-eaed651cb1e1 for instance with vm_state active and task_state None.
Sep 04 23:32:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2', 'serial': 'de00c290-9901-4a07-a36b-3c72efad00f2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': '390c94ba-aa06-42ad-adbb-cc7169c7d2db', 'serial'} {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7765}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:24 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:24 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:24 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b794a0e-77b5-4bc4-9546-3f2bd8370e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:32:24 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb156a0-0082-4dbe-ad40-e46fef9dc9d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2] added
Sep 04 23:32:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf67bf7-d2b1-41eb-af5f-b6627a9dcfc2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983d0da-6955-4e03-ba61-0e02cb941425]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzpYPGFn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzpYPGFn" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065ae0d-beb3-4029-8e7f-b91d9715828f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzpYPGFn'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97ead88-1e13-45dc-afba-e0e01bf03258]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f0e18a-0bda-44b2-a211-c505585c3863]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:24 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a64e022-00bc-4a6d-bd41-eb2a05d73c2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260]
Sep 04 23:32:25 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[04730af4-e653-474b-8957-dc108ac1d2e0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d492a6d3-c40f-4450-a076-914cd8b10ba3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:25 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c6d90-6985-42f1-9a62-9e7e26a8c0c8]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:32:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26532633233633263', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532633233633263', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:32:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lazy-loading 'flavor' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 281018368 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 405798912 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 752877568 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 916455424 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:30 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7174e3d5-7376-47b5-8d24-cbb431414ff1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75913ec-54fc-4585-8e17-538bfc9a5992]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:30 user nova-compute[72954]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:30 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13015b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'): ({'sdi'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Removing single pathed devices sdi {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0742377-faa8-4252-aa8b-f258365de130]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713f2ef-6a61-4632-ad82-d449295a7588]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Flushing IO for device /dev/sdi {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d7eb2-3019-4afa-9504-74b95315a84a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:32:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421ac22-030b-4479-83a5-beac213296b9]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] SCSI volumes sdi have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be57993-0759-4d1e-a6d3-746fb7886b6a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a4f44-f91b-4139-afdc-ec4115883e75]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]
Sep 04 23:32:31 user nova-compute[72954]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4569e-b8ae-4b1d-b487-65f8a61816d5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== disconnect_volume: return (318ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2', 'serial'} {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7774}}
Sep 04 23:32:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: removing Cinder connection for volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7819}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: Updating volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "EzpYPGFn", "auth_password": "X8cwkiLDCrlTdP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "de00c290-9901-4a07-a36b-3c72efad00f2"}, "status": "reserved", "instance": "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98", "attached_at": "", "detached_at": "", "volume_id": "de00c290-9901-4a07-a36b-3c72efad00f2", "serial": "de00c290-9901-4a07-a36b-3c72efad00f2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2', 'no_device': None, 'attachment_id': '65dfbe0b-89c9-4a31-823b-3f166872ebf8'} {{(pid=72954) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7967}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f6bd9c4-8b61-4e85-a26f-55aa226cc406 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.291s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG os_brick.utils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f814143-e728-4d9a-a55f-d07ff17657fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9acec3-e782-4cda-b05d-4037987537e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700e0ad-a291-4d08-90e0-9c25ea320ff5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cc630a-d146-486f-a5c6-a9223d416f1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:33 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:32:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a3d34d-a05d-407a-94cf-15da2e320307]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:32:33 user nova-compute[72954]: DEBUG os_brick.utils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:33 user nova-compute[72954]: INFO nova.compute.manager [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Swapping volume de00c290-9901-4a07-a36b-3c72efad00f2 for 390c94ba-aa06-42ad-adbb-cc7169c7d2db
Sep 04 23:32:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:32:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Creating image(s)
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Ensure instance console log exists: /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start _get_guest_xml network_info=[{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e25e677-e6be-43ef-9663-6c6fdeddf302', 'attached_at': '', 'detached_at': '', 'volume_id': '96933111-ff82-4d21-a7e8-79822ca9489d', 'serial': '96933111-ff82-4d21-a7e8-79822ca9489d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'cff98b9e-0979-47ac-af48-50e61b1481f6', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:32:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:35 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[795980c3-d455-43fa-8d74-6a9b0f1a5a96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:32:35 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f4f51-f0c4-45bd-a738-9b9b3bc6bd77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d] added
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[521f5593-ddb4-4083-9d09-6d6f1f0c3f69]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49766b-3e70-4199-ba50-fbb8547ccccb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsukmZjb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsukmZjb" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380eaab-c343-4cd9-8387-ab1768c99638]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rsukmZjb'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb678de7-545c-440c-86cd-eb35b0e95748]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[762fb3cd-0499-4d16-ae84-44684debf858]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9aceee-2d45-4c69-a7b0-04b684ee62ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260]
Sep 04 23:32:35 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8811495-e439-4960-a4f2-4a10729c1e77]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8347eb57-dea3-42a2-a50f-c76628299505]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6182cd1f-2ef6-4c1b-8ebc-33d37b0a3e1d]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:32:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23762623763333339', 'path': '/dev/sdi'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762623763333339', 'path': '/dev/sdi'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1198513030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1198513030',id=14,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5i7yepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:32:12Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=2e25e677-e6be-43ef-9663-6c6fdeddf302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.objects.instance [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:32:36 user nova-compute[72954]:   <uuid>2e25e677-e6be-43ef-9663-6c6fdeddf302</uuid>
Sep 04 23:32:36 user nova-compute[72954]:   <name>instance-0000000e</name>
Sep 04 23:32:36 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:32:36 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:32:36 user nova-compute[72954]:   <metadata>
Sep 04 23:32:36 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:36 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1198513030</nova:name>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:32:35</nova:creationTime>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:32:36 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:36 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:owner>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:user uuid="9f90f45a06454ddaa392e6cbfe58eeca">tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member</nova:user>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:project uuid="cf4c625d90e54690b8cbb9d0c4cd6e54">tempest-ServerBootFromVolumeStableRescueTest-974522082</nova:project>
Sep 04 23:32:36 user nova-compute[72954]:       </nova:owner>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:36 user nova-compute[72954]:       <nova:ports>
Sep 04 23:32:36 user nova-compute[72954]:         <nova:port uuid="9dc15794-54ed-4c11-a4d7-76c4c3f2b92c">
Sep 04 23:32:36 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Sep 04 23:32:36 user nova-compute[72954]:         </nova:port>
Sep 04 23:32:36 user nova-compute[72954]:       </nova:ports>
Sep 04 23:32:36 user nova-compute[72954]:     </nova:instance>
Sep 04 23:32:36 user nova-compute[72954]:   </metadata>
Sep 04 23:32:36 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:32:36 user nova-compute[72954]:     <system>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="serial">2e25e677-e6be-43ef-9663-6c6fdeddf302</entry>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="uuid">2e25e677-e6be-43ef-9663-6c6fdeddf302</entry>
Sep 04 23:32:36 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:32:36 user nova-compute[72954]:     </system>
Sep 04 23:32:36 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:36 user nova-compute[72954]:   <os>
Sep 04 23:32:36 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:32:36 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:32:36 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:32:36 user nova-compute[72954]:   </os>
Sep 04 23:32:36 user nova-compute[72954]:   <features>
Sep 04 23:32:36 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:36 user nova-compute[72954]:     <apic/>
Sep 04 23:32:36 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:32:36 user nova-compute[72954]:   </features>
Sep 04 23:32:36 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:32:36 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:32:36 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:32:36 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:32:36 user nova-compute[72954]:   </clock>
Sep 04 23:32:36 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:32:36 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:32:36 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:32:36 user nova-compute[72954]:   </cpu>
Sep 04 23:32:36 user nova-compute[72954]:   <devices>
Sep 04 23:32:36 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:32:36 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:36 user nova-compute[72954]:       <source dev="/dev/sdi"/>
Sep 04 23:32:36 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:32:36 user nova-compute[72954]:       <serial>96933111-ff82-4d21-a7e8-79822ca9489d</serial>
Sep 04 23:32:36 user nova-compute[72954]:     </disk>
Sep 04 23:32:36 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:32:36 user nova-compute[72954]:       <mac address="fa:16:3e:4b:cb:d8"/>
Sep 04 23:32:36 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:32:36 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:32:36 user nova-compute[72954]:       <target dev="tap9dc15794-54"/>
Sep 04 23:32:36 user nova-compute[72954]:     </interface>
Sep 04 23:32:36 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:32:36 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/console.log" append="off"/>
Sep 04 23:32:36 user nova-compute[72954]:     </serial>
Sep 04 23:32:36 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:32:36 user nova-compute[72954]:     <video>
Sep 04 23:32:36 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:32:36 user nova-compute[72954]:     </video>
Sep 04 23:32:36 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:32:36 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:32:36 user nova-compute[72954]:     </rng>
Sep 04 23:32:36 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:32:36 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:32:36 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:32:36 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:36 user nova-compute[72954]:   </devices>
Sep 04 23:32:36 user nova-compute[72954]: </domain>
Sep 04 23:32:36 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1198513030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1198513030',id=14,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5i7yepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:32:12Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=2e25e677-e6be-43ef-9663-6c6fdeddf302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG os_vif [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dc15794-54, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dc15794-54, col_values=(('external_ids', {'iface-id': '9dc15794-54ed-4c11-a4d7-76c4c3f2b92c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cb:d8', 'vm-uuid': '2e25e677-e6be-43ef-9663-6c6fdeddf302'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:36 user nova-compute[72954]: INFO os_vif [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54')
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No VIF found with MAC fa:16:3e:4b:cb:d8, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:32:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:38 user nova-compute[72954]: WARNING nova.compute.manager [req-bf7ecd42-b2a0-48f8-ab60-5d9c724b9313 req-428be0cc-688f-4b93-9247-67a864faf82e service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state building and task_state spawning.
Sep 04 23:32:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870359.9211578, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:32:39 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Resumed (Lifecycle Event)
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:32:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance spawned successfully.
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:39 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:32:39 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870359.922243, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:32:39 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Started (Lifecycle Event)
Sep 04 23:32:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:32:40 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:32:40 user nova-compute[72954]: INFO nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Took 4.95 seconds to spawn the instance on the hypervisor.
Sep 04 23:32:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:40 user nova-compute[72954]: WARNING nova.compute.manager [req-aa658101-215e-4752-85cc-4974a9606b75 req-96c0b291-54e8-4b4d-9929-225e4645b994 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state building and task_state spawning.
Sep 04 23:32:40 user nova-compute[72954]: INFO nova.compute.manager [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Took 28.61 seconds to build instance.
Sep 04 23:32:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-43e3911b-6edd-48c1-b3f3-a419a6688e64 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.704s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:32:45 user nova-compute[72954]: INFO nova.compute.claims [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Claim successful on node user
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:32:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.policy [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b7def3475ff4df1a6ce5664ecbe33cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa30aac7532d4178be510b5f39c3211c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:32:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Creating image(s)
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "/opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "/opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk 1073741824" returned: 0 in 0.221s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.417s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Successfully created port: 6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Cannot resize image /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Ensure instance console log exists: /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Successfully updated port: 6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquired lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-changed-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Refreshing instance network info cache due to event network-changed-6a629503-3a27-421c-b44e-cbac53022d75. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] Acquiring lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Updating instance_info_cache with network_info: [{"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Releasing lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Instance network_info: |[{"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] Acquired lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.neutron [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Refreshing network info cache for port 6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Start _get_guest_xml network_info=[{"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:32:48 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:48 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-892851063',display_name='tempest-VolumesAdminNegativeTest-server-892851063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-892851063',id=15,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-qtf4zh6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:32:47Z,user_data=None,user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:32:48 user nova-compute[72954]:   <uuid>00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57</uuid>
Sep 04 23:32:48 user nova-compute[72954]:   <name>instance-0000000f</name>
Sep 04 23:32:48 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:32:48 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:32:48 user nova-compute[72954]:   <metadata>
Sep 04 23:32:48 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:32:48 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:name>tempest-VolumesAdminNegativeTest-server-892851063</nova:name>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:32:48</nova:creationTime>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:32:48 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:32:48 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:owner>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:user uuid="9b7def3475ff4df1a6ce5664ecbe33cd">tempest-VolumesAdminNegativeTest-647256197-project-member</nova:user>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:project uuid="fa30aac7532d4178be510b5f39c3211c">tempest-VolumesAdminNegativeTest-647256197</nova:project>
Sep 04 23:32:48 user nova-compute[72954]:       </nova:owner>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:32:48 user nova-compute[72954]:       <nova:ports>
Sep 04 23:32:48 user nova-compute[72954]:         <nova:port uuid="6a629503-3a27-421c-b44e-cbac53022d75">
Sep 04 23:32:48 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Sep 04 23:32:48 user nova-compute[72954]:         </nova:port>
Sep 04 23:32:48 user nova-compute[72954]:       </nova:ports>
Sep 04 23:32:48 user nova-compute[72954]:     </nova:instance>
Sep 04 23:32:48 user nova-compute[72954]:   </metadata>
Sep 04 23:32:48 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:32:48 user nova-compute[72954]:     <system>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="serial">00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57</entry>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="uuid">00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57</entry>
Sep 04 23:32:48 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:32:48 user nova-compute[72954]:     </system>
Sep 04 23:32:48 user nova-compute[72954]:   </sysinfo>
Sep 04 23:32:48 user nova-compute[72954]:   <os>
Sep 04 23:32:48 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:32:48 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:32:48 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:32:48 user nova-compute[72954]:   </os>
Sep 04 23:32:48 user nova-compute[72954]:   <features>
Sep 04 23:32:48 user nova-compute[72954]:     <acpi/>
Sep 04 23:32:48 user nova-compute[72954]:     <apic/>
Sep 04 23:32:48 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:32:48 user nova-compute[72954]:   </features>
Sep 04 23:32:48 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:32:48 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:32:48 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:32:48 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:32:48 user nova-compute[72954]:   </clock>
Sep 04 23:32:48 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:32:48 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:32:48 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:32:48 user nova-compute[72954]:   </cpu>
Sep 04 23:32:48 user nova-compute[72954]:   <devices>
Sep 04 23:32:48 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:32:48 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:32:48 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk"/>
Sep 04 23:32:48 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:32:48 user nova-compute[72954]:     </disk>
Sep 04 23:32:48 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:32:48 user nova-compute[72954]:       <mac address="fa:16:3e:64:5a:97"/>
Sep 04 23:32:48 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:32:48 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:32:48 user nova-compute[72954]:       <target dev="tap6a629503-3a"/>
Sep 04 23:32:48 user nova-compute[72954]:     </interface>
Sep 04 23:32:48 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:32:48 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/console.log" append="off"/>
Sep 04 23:32:48 user nova-compute[72954]:     </serial>
Sep 04 23:32:48 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:32:48 user nova-compute[72954]:     <video>
Sep 04 23:32:48 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:32:48 user nova-compute[72954]:     </video>
Sep 04 23:32:48 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:32:48 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:32:48 user nova-compute[72954]:     </rng>
Sep 04 23:32:48 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:32:48 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:32:48 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:32:48 user nova-compute[72954]:     </memballoon>
Sep 04 23:32:48 user nova-compute[72954]:   </devices>
Sep 04 23:32:48 user nova-compute[72954]: </domain>
Sep 04 23:32:48 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-892851063',display_name='tempest-VolumesAdminNegativeTest-server-892851063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-892851063',id=15,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-qtf4zh6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:32:47Z,user_data=None,user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG os_vif [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a629503-3a, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a629503-3a, col_values=(('external_ids', {'iface-id': '6a629503-3a27-421c-b44e-cbac53022d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:5a:97', 'vm-uuid': '00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:48 user nova-compute[72954]: INFO os_vif [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a')
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:32:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] No VIF found with MAC fa:16:3e:64:5a:97, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': '390c94ba-aa06-42ad-adbb-cc7169c7d2db', 'serial': '390c94ba-aa06-42ad-adbb-cc7169c7d2db'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2'}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2', 'serial'} {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7765}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:49 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7946301b-be87-4a90-8c6f-d585d8163b80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:32:49 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6f39b-62c2-4ba1-bb26-441527f213a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db] added
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb4950-bcfc-489e-b413-d50ba861f8a4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[31009db8-d3ed-4123-b45f-86a0895d28f6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Updated VIF entry in instance network info cache for port 6a629503-3a27-421c-b44e-cbac53022d75. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Updating instance_info_cache with network_info: [{"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhyNrRim {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhyNrRim" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8392e04-5237-4b68-9c02-11037c46d8d4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DhyNrRim'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-935a52ec-aef5-4996-b94e-46ef68532fe5 req-c7d9e755-193e-47ea-95c4-c335d472774a service nova] Releasing lock "refresh_cache-00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b6323f-6777-4f43-8d4c-d6d96d70ea4e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955595d-317d-4e9e-b677-f3b0a5a38075]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[85700f7e-da5e-49bc-901b-a8b744551713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]
Sep 04 23:32:49 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d17f788-5aa1-4ba6-83e1-d729ce473605]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8534a4d-f6e4-4836-9484-55243ff5c32a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e446575-fa85-4ed0-a46f-9c9b81425d51]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:32:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] No waiting events found dispatching network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:50 user nova-compute[72954]: WARNING nova.compute.manager [req-eb8c7a7e-6ec3-473b-950f-631aae117cad req-3cb3f574-9565-4c07-9f9f-bbc7d7b364b6 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received unexpected event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 for instance with vm_state building and task_state spawning.
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23730373138626465', 'path': '/dev/sdj'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373138626465', 'path': '/dev/sdj'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lazy-loading 'flavor' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] No waiting events found dispatching network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:32:52 user nova-compute[72954]: WARNING nova.compute.manager [req-fc81198b-2cb6-426a-b836-733b803da464 req-07c2ada2-2946-4937-a3d8-6010da6561d0 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received unexpected event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 for instance with vm_state building and task_state spawning.
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870372.455492, 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] VM Resumed (Lifecycle Event)
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Instance spawned successfully.
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870372.4570553, 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] VM Started (Lifecycle Event)
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Took 5.93 seconds to spawn the instance on the hypervisor.
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:32:52 user nova-compute[72954]: INFO nova.compute.manager [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Took 6.80 seconds to build instance.
Sep 04 23:32:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c46d69-9652-4888-b9fa-aea7599eeb4b tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.897s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 672137216 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:32:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 804257792 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 989855744 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzpYPGFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'de00c290-9901-4a07-a36b-3c72efad00f2'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b55597-1ad2-4d99-9f9d-ea556a059253]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73ba9a-3366-4764-b0f8-c8eb42c3256c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1381a4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334bd43-8ae7-4fd6-82f4-86b1b27474d5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3d0118-3c0a-460d-b22f-1f782479ffbf]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c7dea-a87b-47f7-89ef-03f11641419e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b41419-41fe-4f9c-88ba-2b39a67d6979]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4e758-ebe2-4129-b505-93ce8549caf6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dcdc95-65bf-4c65-8d43-4f22c7f3223d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260]
Sep 04 23:32:55 user nova-compute[72954]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de00c290-9901-4a07-a36b-3c72efad00f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7805d49-cf71-406e-b67a-b7006d4c777c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] <== disconnect_volume: return (320ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'e4b9dde7-133f-4f2a-b2e4-6cdafb61db98', 'attached_at': '', 'detached_at': '', 'volume_id': '390c94ba-aa06-42ad-adbb-cc7169c7d2db', 'serial'} {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7774}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: removing Cinder connection for volume de00c290-9901-4a07-a36b-3c72efad00f2 {{(pid=72954) _swap_volume /opt/stack/nova/nova/compute/manager.py:7819}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'flavor' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attaching volume cfa2fb37-1283-4806-b2e7-e9abc46618aa to /dev/vdb
Sep 04 23:32:55 user nova-compute[72954]: DEBUG os_brick.utils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[df681677-74cb-4afc-9154-eb8ee0990903]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7f56d-920e-49da-ab30-dbdb23d26409]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[760bbac2-2cc1-48e8-b570-196f00246a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce159520-2a4f-437d-bd73-91bc3055371d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:32:56 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:32:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d11f66-2e3b-48c2-8cd8-256a5cd57a01]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG os_brick.utils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating existing volume attachment record: 1338fca3-653a-4075-9863-55db081603dd {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] swap_volume: Updating volume de00c290-9901-4a07-a36b-3c72efad00f2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "DhyNrRim", "auth_password": "e2QHXERFOmIwft", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "390c94ba-aa06-42ad-adbb-cc7169c7d2db"}, "status": "reserved", "instance": "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98", "attached_at": "", "detached_at": "", "volume_id": "390c94ba-aa06-42ad-adbb-cc7169c7d2db", "serial": "390c94ba-aa06-42ad-adbb-cc7169c7d2db"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '390c94ba-aa06-42ad-adbb-cc7169c7d2db', 'no_device': None, 'attachment_id': 'a411fff3-15f1-41b8-9eeb-0908655e3afa'} {{(pid=72954) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7967}}
Sep 04 23:32:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dfcae36a-fd41-4daa-91da-7a5a0efad838 tempest-TestVolumeSwap-1124185484 tempest-TestVolumeSwap-1124185484-project-admin] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.541s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:32:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:32:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:32:58 user nova-compute[72954]: INFO nova.compute.manager [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Detaching volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db
Sep 04 23:32:58 user nova-compute[72954]: INFO nova.virt.block_device [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Attempting to driver detach volume 390c94ba-aa06-42ad-adbb-cc7169c7d2db from mountpoint /dev/vdb
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Attempting to detach device vdb from instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:58 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:58 user nova-compute[72954]:   <source dev="/dev/sdj"/>
Sep 04 23:32:58 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:58 user nova-compute[72954]:   <serial>390c94ba-aa06-42ad-adbb-cc7169c7d2db</serial>
Sep 04 23:32:58 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:32:58 user nova-compute[72954]: </disk>
Sep 04 23:32:58 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Successfully detached device vdb from instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 from the persistent domain config.
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:32:58 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:32:58 user nova-compute[72954]:   <source dev="/dev/sdj"/>
Sep 04 23:32:58 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:32:58 user nova-compute[72954]:   <serial>390c94ba-aa06-42ad-adbb-cc7169c7d2db</serial>
Sep 04 23:32:58 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:32:58 user nova-compute[72954]: </disk>
Sep 04 23:32:58 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870378.7040782, e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:32:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Successfully detached device vdb from instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 from the live domain config.
Sep 04 23:32:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhyNrRim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '390c94ba-aa06-42ad-adbb-cc7169c7d2db'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:32:58 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe9b6c1-63c8-479e-8b85-cbfc5eee9c61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e54f24-cc50-42da-b662-e9c8fba07e94]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:32:58 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130388c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db'): ({'sdj'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Removing single pathed devices sdj {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3f355-3614-4415-8324-6cbf80eea7a9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de81a7d4-eaf8-4c37-8ab4-6458ae484a65]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Flushing IO for device /dev/sdj {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3424d6-956a-4e6c-b6e5-40084ae63113]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a4bde-3365-4343-b4aa-2b44896d147e]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] SCSI volumes sdj have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93e7f7c-363d-4cd4-8525-e3f8b9091428]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f4617d-9f83-4df5-9193-c868b3d416cd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260]
Sep 04 23:32:59 user nova-compute[72954]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db, portal: 172.16.0.220,3260] successful.
Sep 04 23:32:59 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:390c94ba-aa06-42ad-adbb-cc7169c7d2db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfffd8-601f-4ce7-9f27-0ff09c2dc0ab]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] <== disconnect_volume: return (349ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:32:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG nova.objects.instance [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lazy-loading 'flavor' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f7739b42-e83b-4411-b1a0-06450cb0f6ae tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.274s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:33:00 user nova-compute[72954]: INFO nova.compute.claims [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Claim successful on node user
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:33:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.policy [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3694a9f4359a487db80ec71c526201be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f8d4f90e74533b0f0b96581c8bd5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:33:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Creating image(s)
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk 1073741824" returned: 0 in 0.050s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Cannot resize image /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Ensure instance console log exists: /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Successfully created port: 49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Successfully updated port: 49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-changed-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Refreshing instance network info cache due to event network-changed-49a6e5e0-5816-4f60-84fd-5e97b0f86faf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] Acquiring lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating instance_info_cache with network_info: [{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance network_info: |[{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] Acquired lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Refreshing network info cache for port 49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start _get_guest_xml network_info=[{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:33:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:03 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-tempest.common.compute-instance-1879543623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.objects.instance [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'pci_devices' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:33:03 user nova-compute[72954]:   <uuid>98b7e205-7840-4e98-9f69-2cf6e7142202</uuid>
Sep 04 23:33:03 user nova-compute[72954]:   <name>instance-00000010</name>
Sep 04 23:33:03 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:33:03 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:33:03 user nova-compute[72954]:   <metadata>
Sep 04 23:33:03 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:33:03 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:name>tempest-tempest.common.compute-instance-1879543623</nova:name>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:33:03</nova:creationTime>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:33:03 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:33:03 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:owner>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:user uuid="3694a9f4359a487db80ec71c526201be">tempest-ServerActionsTestOtherA-520106611-project-member</nova:user>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:project uuid="9c2f8d4f90e74533b0f0b96581c8bd5a">tempest-ServerActionsTestOtherA-520106611</nova:project>
Sep 04 23:33:03 user nova-compute[72954]:       </nova:owner>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:33:03 user nova-compute[72954]:       <nova:ports>
Sep 04 23:33:03 user nova-compute[72954]:         <nova:port uuid="49a6e5e0-5816-4f60-84fd-5e97b0f86faf">
Sep 04 23:33:03 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 04 23:33:03 user nova-compute[72954]:         </nova:port>
Sep 04 23:33:03 user nova-compute[72954]:       </nova:ports>
Sep 04 23:33:03 user nova-compute[72954]:     </nova:instance>
Sep 04 23:33:03 user nova-compute[72954]:   </metadata>
Sep 04 23:33:03 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:33:03 user nova-compute[72954]:     <system>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="serial">98b7e205-7840-4e98-9f69-2cf6e7142202</entry>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="uuid">98b7e205-7840-4e98-9f69-2cf6e7142202</entry>
Sep 04 23:33:03 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:33:03 user nova-compute[72954]:     </system>
Sep 04 23:33:03 user nova-compute[72954]:   </sysinfo>
Sep 04 23:33:03 user nova-compute[72954]:   <os>
Sep 04 23:33:03 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:33:03 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:33:03 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:33:03 user nova-compute[72954]:   </os>
Sep 04 23:33:03 user nova-compute[72954]:   <features>
Sep 04 23:33:03 user nova-compute[72954]:     <acpi/>
Sep 04 23:33:03 user nova-compute[72954]:     <apic/>
Sep 04 23:33:03 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:33:03 user nova-compute[72954]:   </features>
Sep 04 23:33:03 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:33:03 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:33:03 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:33:03 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:33:03 user nova-compute[72954]:   </clock>
Sep 04 23:33:03 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:33:03 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:33:03 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:33:03 user nova-compute[72954]:   </cpu>
Sep 04 23:33:03 user nova-compute[72954]:   <devices>
Sep 04 23:33:03 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:33:03 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:33:03 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk"/>
Sep 04 23:33:03 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:33:03 user nova-compute[72954]:     </disk>
Sep 04 23:33:03 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:33:03 user nova-compute[72954]:       <mac address="fa:16:3e:17:e9:5d"/>
Sep 04 23:33:03 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:03 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:33:03 user nova-compute[72954]:       <target dev="tap49a6e5e0-58"/>
Sep 04 23:33:03 user nova-compute[72954]:     </interface>
Sep 04 23:33:03 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:33:03 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/console.log" append="off"/>
Sep 04 23:33:03 user nova-compute[72954]:     </serial>
Sep 04 23:33:03 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:33:03 user nova-compute[72954]:     <video>
Sep 04 23:33:03 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:03 user nova-compute[72954]:     </video>
Sep 04 23:33:03 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:33:03 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:33:03 user nova-compute[72954]:     </rng>
Sep 04 23:33:03 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:33:03 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:33:03 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:33:03 user nova-compute[72954]:     </memballoon>
Sep 04 23:33:03 user nova-compute[72954]:   </devices>
Sep 04 23:33:03 user nova-compute[72954]: </domain>
Sep 04 23:33:03 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-tempest.common.compute-instance-1879543623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG os_vif [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a6e5e0-58, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49a6e5e0-58, col_values=(('external_ids', {'iface-id': '49a6e5e0-5816-4f60-84fd-5e97b0f86faf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:e9:5d', 'vm-uuid': '98b7e205-7840-4e98-9f69-2cf6e7142202'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:03 user nova-compute[72954]: INFO os_vif [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58')
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:17:e9:5d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updated VIF entry in instance network info cache for port 49a6e5e0-5816-4f60-84fd-5e97b0f86faf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating instance_info_cache with network_info: [{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4db70038-4c6e-4e8e-8de7-a1be4f4b9611 req-74ec9828-ce6c-44a4-ae8c-2b2e2871540d service nova] Releasing lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:33:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:05 user nova-compute[72954]: WARNING nova.compute.manager [req-99893b47-444b-47e2-955c-f8a5f66ae83b req-2062ad29-a2d6-4515-8bb2-f05e6be2200b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state building and task_state spawning.
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:07 user nova-compute[72954]: WARNING nova.compute.manager [req-be91540e-395e-4dfd-b950-a917b416451a req-33d50630-7304-407d-acc9-8d96c5e12dc5 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state building and task_state spawning.
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870387.327629, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Resumed (Lifecycle Event)
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance spawned successfully.
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870387.3333955, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Started (Lifecycle Event)
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Took 5.91 seconds to spawn the instance on the hypervisor.
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:07 user nova-compute[72954]: INFO nova.compute.manager [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Took 6.87 seconds to build instance.
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-39cee482-deae-40dc-9804-cf88ac93afab tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.971s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:33:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:08 user nova-compute[72954]: INFO nova.compute.manager [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Terminating instance
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-unplugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] No waiting events found dispatching network-vif-unplugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bc30001-ded8-491a-9a71-a372eacdd1b8 req-3c1dd83c-78eb-484f-87d4-91b59317455e service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-unplugged-81b7735f-58c5-428a-89ef-7d7e1500e180 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Instance destroyed successfully.
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lazy-loading 'resources' on Instance uuid ffeb12e3-6924-4536-9d90-23064511fee8 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1166778422',display_name='tempest-VolumesAssistedSnapshotsTest-server-1166778422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1166778422',id=10,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP96PwyWYwqUBEPVp1e+WzgCmhbRoPI6UO8M3D9lk9l/HE9z9iYpq0saXpWE8co8mZz1Ql+WHJaHzJlnD6k72Gz+CCYZzBHeyhDpF/4NX4ByvoMDFic/UbgEC+j8cHLKA==',key_name='tempest-keypair-393069947',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:30:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58a8fa3b55ac4df2a926625cae56e5da',ramdisk_id='',reservation_id='r-agu4xsut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1430164163',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1430164163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:30:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a882d3b4957e4419b1b6afd01063a48d',uuid=ffeb12e3-6924-4536-9d90-23064511fee8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converting VIF {"id": "81b7735f-58c5-428a-89ef-7d7e1500e180", "address": "fa:16:3e:cd:c4:1f", "network": {"id": "2fe88b00-f75c-49a5-a177-b2fad9a9b260", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2012297454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a8fa3b55ac4df2a926625cae56e5da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b7735f-58", "ovs_interfaceid": "81b7735f-58c5-428a-89ef-7d7e1500e180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG os_vif [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b7735f-58, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:08 user nova-compute[72954]: INFO os_vif [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:1f,bridge_name='br-int',has_traffic_filtering=True,id=81b7735f-58c5-428a-89ef-7d7e1500e180,network=Network(2fe88b00-f75c-49a5-a177-b2fad9a9b260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81b7735f-58')
Sep 04 23:33:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Deleting instance files /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8_del
Sep 04 23:33:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Deletion of /opt/stack/data/nova/instances/ffeb12e3-6924-4536-9d90-23064511fee8_del complete
Sep 04 23:33:09 user nova-compute[72954]: INFO nova.compute.manager [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Took 0.97 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid 'ffeb12e3-6924-4536-9d90-23064511fee8' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ffeb12e3-6924-4536-9d90-23064511fee8' (instance-0000000a)
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:09 user nova-compute[72954]: INFO nova.compute.manager [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Terminating instance
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-unplugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-unplugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-eea50bb7-0953-4e2f-80ff-827da0cb3f10 req-ccdde59b-0b14-40b5-be9e-3fa33dea31e8 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-unplugged-1d7af612-bd03-4234-b329-92603ec8e2ce for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Took 1.21 seconds to deallocate network for instance.
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Instance destroyed successfully.
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lazy-loading 'resources' on Instance uuid 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1212774869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1212774869',id=9,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3UiPPCEXqyfAZfFS0VHVH4hX/7LlhVDw133k8uZf9c+yTleDoc9JOIInktlHWKsUtyk1UzzfeLZIRx0FDCGpbqEXhC8pC+VCKTgFClQaaGpaL3hr6YSVwyfa82jAgfVw==',key_name='tempest-keypair-1586770986',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed713e4a84fe4a8eb43e342c36a2f860',ramdisk_id='',reservation_id='r-alxra3at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-669860998',owner_user_name='tempest-TaggedAttachmentsTest-669860998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7cb888448fb4c389096c8be0e881847',uuid=6f2dd93c-0564-4e76-8219-a4e5a7aaace5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converting VIF {"id": "1d7af612-bd03-4234-b329-92603ec8e2ce", "address": "fa:16:3e:a2:3d:13", "network": {"id": "7351602f-c3ac-4e66-90f0-fffec86c8e30", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1262809093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed713e4a84fe4a8eb43e342c36a2f860", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7af612-bd", "ovs_interfaceid": "1d7af612-bd03-4234-b329-92603ec8e2ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG os_vif [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d7af612-bd, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: INFO os_vif [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:3d:13,bridge_name='br-int',has_traffic_filtering=True,id=1d7af612-bd03-4234-b329-92603ec8e2ce,network=Network(7351602f-c3ac-4e66-90f0-fffec86c8e30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7af612-bd')
Sep 04 23:33:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Deleting instance files /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5_del
Sep 04 23:33:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Deletion of /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5_del complete
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] Acquiring lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] Lock "ffeb12e3-6924-4536-9d90-23064511fee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] No waiting events found dispatching network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:10 user nova-compute[72954]: WARNING nova.compute.manager [req-0ec3c5ff-ddc0-4e0b-b3ac-e0334c5d26a4 req-e48599b4-463c-4e8c-96c2-7f25f7892c92 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received unexpected event network-vif-plugged-81b7735f-58c5-428a-89ef-7d7e1500e180 for instance with vm_state deleted and task_state None.
Sep 04 23:33:10 user nova-compute[72954]: INFO nova.compute.manager [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Took 1.03 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json" returned: 1 in 0.212s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk --force-share --output=json' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:33:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000009, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/6f2dd93c-0564-4e76-8219-a4e5a7aaace5/disk
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.779s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:11 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Deleted allocations for instance ffeb12e3-6924-4536-9d90-23064511fee8
Sep 04 23:33:11 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:11 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Took 0.80 seconds to deallocate network for instance.
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ce9f7ab-c188-4a44-adda-bff944d6fac2 tempest-VolumesAssistedSnapshotsTest-1430164163 tempest-VolumesAssistedSnapshotsTest-1430164163-project-member] Lock "ffeb12e3-6924-4536-9d90-23064511fee8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.605s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Received event network-vif-deleted-81b7735f-58c5-428a-89ef-7d7e1500e180 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] Acquiring lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] No waiting events found dispatching network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:12 user nova-compute[72954]: WARNING nova.compute.manager [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received unexpected event network-vif-plugged-1d7af612-bd03-4234-b329-92603ec8e2ce for instance with vm_state deleted and task_state None.
Sep 04 23:33:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bcda579-70ee-496c-b0b9-e9ed6a899ab8 req-d88f63a0-add7-41d8-85b9-215963123ce3 service nova] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Received event network-vif-deleted-1d7af612-bd03-4234-b329-92603ec8e2ce {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:12 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Deleted allocations for instance 6f2dd93c-0564-4e76-8219-a4e5a7aaace5
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7928e83e-7f7b-4dcf-968d-ade8c6c2be97 tempest-TaggedAttachmentsTest-669860998 tempest-TaggedAttachmentsTest-669860998-project-member] Lock "6f2dd93c-0564-4e76-8219-a4e5a7aaace5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.782s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:13 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:13 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:13 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c0a4a9-44e6-4502-b7fa-d735ed62cf87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:33:13 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a2ecb-d5c9-4c84-b089-0b3970494a3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa] added
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619788b-1721-48c2-affe-1344be2954c4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45f9d6-2696-4ec3-9248-581d1948ef0a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpFEGRJe {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:13 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=6663MB free_disk=25.3634033203125GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpFEGRJe" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27694b2b-d21f-4d46-b4c9-df13431bfc69]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpFEGRJe'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5fee1-a825-404e-877b-eab813c9382d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096be81-5f3d-4795-930f-60c5b9d8913f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 59f79766-4fb0-43e2-9f3e-9eed3d9129bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 621de8a1-f2a6-4337-a53e-6667555c8532 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eeb115-54ba-46f2-ac20-f0652f94fc86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260]
Sep 04 23:33:13 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[febdb71f-0e84-4063-8557-00637fcd55f9]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d837fd5-a2f2-4856-b11d-3adf2db80012]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.888s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8085d-b89d-412f-8404-49e9bd859306]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:33:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.795s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.931s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] <== connect_volume: return (1933ms) {'type': 'block', 'scsi_wwn': '23830633061633264', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633061633264', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:33:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'flavor' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:33:15 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:33:15 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:33:15 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:33:15 user nova-compute[72954]:   <serial>cfa2fb37-1283-4806-b2e7-e9abc46618aa</serial>
Sep 04 23:33:15 user nova-compute[72954]: </disk>
Sep 04 23:33:15 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No VIF found with MAC fa:16:3e:26:d9:48, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a8bcfac-7482-41d5-9946-3f685710dd20 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.820s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:15 user nova-compute[72954]: INFO nova.compute.manager [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Terminating instance
Sep 04 23:33:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-unplugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] No waiting events found dispatching network-vif-unplugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0f0f5b5e-b7a9-47f6-8a7c-c5bf81ac5a07 req-b645c570-d46e-46f9-a299-fdaf0f48a9f2 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-unplugged-6177b08b-09e9-4936-8c6b-38978698730b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Instance destroyed successfully.
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lazy-loading 'resources' on Instance uuid 59f79766-4fb0-43e2-9f3e-9eed3d9129bd {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:31:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-490238502',display_name='tempest-VolumesNegativeTest-instance-490238502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-490238502',id=13,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67408b8757584970a53ba69cedbb75b2',ramdisk_id='',reservation_id='r-vqsm3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-702867806',owner_user_name='tempest-VolumesNegativeTest-702867806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:32Z,user_data=None,user_id='39677924cdc04659a3a09b7a18197550',uuid=59f79766-4fb0-43e2-9f3e-9eed3d9129bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converting VIF {"id": "6177b08b-09e9-4936-8c6b-38978698730b", "address": "fa:16:3e:e7:1f:57", "network": {"id": "47ff4d53-ea3f-4c66-a603-e0397e4569d2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ec486013ab25483999e5f2ccf38b313f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6177b08b-09", "ovs_interfaceid": "6177b08b-09e9-4936-8c6b-38978698730b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG os_vif [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6177b08b-09, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:16 user nova-compute[72954]: INFO os_vif [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:1f:57,bridge_name='br-int',has_traffic_filtering=True,id=6177b08b-09e9-4936-8c6b-38978698730b,network=Network(47ff4d53-ea3f-4c66-a603-e0397e4569d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6177b08b-09')
Sep 04 23:33:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Deleting instance files /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd_del
Sep 04 23:33:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Deletion of /opt/stack/data/nova/instances/59f79766-4fb0-43e2-9f3e-9eed3d9129bd_del complete
Sep 04 23:33:16 user nova-compute[72954]: INFO nova.compute.manager [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Took 0.70 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:16 user nova-compute[72954]: INFO nova.compute.manager [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Rescuing
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:17 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Took 0.84 seconds to deallocate network for instance.
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-63f4a864-39b5-4aa6-991a-43f06407f4e7 req-8708aa1e-34b5-4317-9a68-e10422b6c915 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-deleted-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:17 user nova-compute[72954]: WARNING nova.compute.manager [req-d8fbaf92-070f-4d24-bbd3-b95377897f17 req-b5cf365b-6a8d-4926-93cf-d62750049a40 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state rescuing.
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:18 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Deleted allocations for instance 59f79766-4fb0-43e2-9f3e-9eed3d9129bd
Sep 04 23:33:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a04ea86c-d0db-408f-9037-d13b70ac83c6 tempest-VolumesNegativeTest-702867806 tempest-VolumesNegativeTest-702867806-project-member] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance destroyed successfully.
Sep 04 23:33:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attempting a stable device rescue
Sep 04 23:33:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72954) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:33:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Creating image(s)
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'trusted_certs' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "5dbbb8ca078988389289a5d47952f304598dc283" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "5dbbb8ca078988389289a5d47952f304598dc283" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] Acquiring lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] Lock "59f79766-4fb0-43e2-9f3e-9eed3d9129bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] No waiting events found dispatching network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:18 user nova-compute[72954]: WARNING nova.compute.manager [req-62e856e7-66c7-4c5c-985e-8c9d24a5a54b req-cbbd5f60-8cc6-4966-8978-9a3a7be83013 service nova] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Received unexpected event network-vif-plugged-6177b08b-09e9-4936-8c6b-38978698730b for instance with vm_state deleted and task_state None.
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.part --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG nova.virt.images [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] 603cc8a5-23bd-4697-bb94-b7ed7215e406 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.part /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:19 user nova-compute[72954]: WARNING nova.compute.manager [req-12e1bc0e-4e9e-4313-abfb-c098c807ccf6 req-26982f89-a273-4c07-9def-b8510f614b1b service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state rescuing.
Sep 04 23:33:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.part /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.converted" returned: 0 in 0.442s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "5dbbb8ca078988389289a5d47952f304598dc283" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.881s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "5dbbb8ca078988389289a5d47952f304598dc283" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "5dbbb8ca078988389289a5d47952f304598dc283" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283 --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283,backing_fmt=raw /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283,backing_fmt=raw /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue" returned: 0 in 0.062s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "5dbbb8ca078988389289a5d47952f304598dc283" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'migration_context' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Object Instance<de97c8d3-65e0-4770-bf2b-44d58b5e403e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start _get_guest_xml network_info=[{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "vif_mac": "fa:16:3e:26:d9:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '603cc8a5-23bd-4697-bb94-b7ed7215e406', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'de97c8d3-65e0-4770-bf2b-44d58b5e403e', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfa2fb37-1283-4806-b2e7-e9abc46618aa', 'serial': 'cfa2fb37-1283-4806-b2e7-e9abc46618aa'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '1338fca3-653a-4075-9863-55db081603dd', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'resources' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Object Instance<de97c8d3-65e0-4770-bf2b-44d58b5e403e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'numa_topology' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Object Instance<de97c8d3-65e0-4770-bf2b-44d58b5e403e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'vcpu_model' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Object Instance<de97c8d3-65e0-4770-bf2b-44d58b5e403e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:20 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:20 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:20 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[100f6d79-3f51-4712-ba4f-106edf31f499]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mpFEGRJe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Sep 04 23:33:20 user nova-compute[72954]: node.name = iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa
Sep 04 23:33:20 user nova-compute[72954]: node.tpgt = -1
Sep 04 23:33:20 user nova-compute[72954]: node.startup = automatic
Sep 04 23:33:20 user nova-compute[72954]: node.leading_login = No
Sep 04 23:33:20 user nova-compute[72954]: iface.iscsi_ifacename = default
Sep 04 23:33:20 user nova-compute[72954]: iface.net_ifacename = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.ipaddress = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.prefix_len = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.hwaddress = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.transport_name = tcp
Sep 04 23:33:20 user nova-compute[72954]: iface.initiatorname = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.vlan_id = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.vlan_priority = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.vlan_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.iface_num = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.mtu = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.port = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.bootproto = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.subnet_mask = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.gateway = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_alt_client_id_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_alt_client_id = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_dns = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_learn_iqn = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_req_vendor_id_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_vendor_id_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_vendor_id = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.dhcp_slp_da = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.fragmentation = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.gratuitous_arp = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.incoming_forwarding = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.tos_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.tos = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.ttl = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.delayed_ack = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.tcp_nagle = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.tcp_wsf_state = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.tcp_wsf = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.tcp_timer_scale = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.tcp_timestamp = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.redirect = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.def_task_mgmt_timeout = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.header_digest = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.data_digest = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.immediate_data = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.initial_r2t = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.data_seq_inorder = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.data_pdu_inorder = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.erl = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.max_receive_data_len = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.first_burst_len = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.max_outstanding_r2t = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.max_burst_len = 0
Sep 04 23:33:20 user nova-compute[72954]: iface.chap_auth = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.bidi_chap = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.strict_login_compliance = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.discovery_auth = <empty>
Sep 04 23:33:20 user nova-compute[72954]: iface.discovery_logout = <empty>
Sep 04 23:33:20 user nova-compute[72954]: node.discovery_address = <empty>
Sep 04 23:33:20 user nova-compute[72954]: node.discovery_port = 0
Sep 04 23:33:20 user nova-compute[72954]: node.discovery_type = static
Sep 04 23:33:20 user nova-compute[72954]: node.session.initial_cmdsn = 0
Sep 04 23:33:20 user nova-compute[72954]: node.session.initial_login_retry_max = 8
Sep 04 23:33:20 user nova-compute[72954]: node.session.xmit_thread_priority = -20
Sep 04 23:33:20 user nova-compute[72954]: node.session.cmds_max = 128
Sep 04 23:33:20 user nova-compute[72954]: node.session.queue_depth = 32
Sep 04 23:33:20 user nova-compute[72954]: node.session.nr_sessions = 1
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.authmethod = CHAP
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.username = mpFEGRJe
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.password = ***
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.username_in = <empty>
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.password_in = <empty>
Sep 04 23:33:20 user nova-compute[72954]: node.session.auth.chap_algs = MD5
Sep 04 23:33:20 user nova-compute[72954]: node.session.timeo.replacement_timeout = 120
Sep 04 23:33:20 user nova-compute[72954]: node.session.err_timeo.abort_timeout = 15
Sep 04 23:33:20 user nova-compute[72954]: node.session.err_timeo.lu_reset_timeout = 30
Sep 04 23:33:20 user nova-compute[72954]: node.session.err_timeo.tgt_reset_timeout = 30
Sep 04 23:33:20 user nova-compute[72954]: node.session.err_timeo.host_reset_timeout = 60
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.FastAbort = Yes
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.InitialR2T = No
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.ImmediateData = Yes
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.FirstBurstLength = 262144
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.MaxBurstLength = 16776192
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.DefaultTime2Retain = 0
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.DefaultTime2Wait = 2
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.MaxConnections = 1
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.MaxOutstandingR2T = 1
Sep 04 23:33:20 user nova-compute[72954]: node.session.iscsi.ERL = 0
Sep 04 23:33:20 user nova-compute[72954]: node.session.scan = manual
Sep 04 23:33:20 user nova-compute[72954]: node.session.reopen_max = 0
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].address = 172.16.0.220
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].port = 3260
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].startup = manual
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].tcp.window_size = 524288
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].tcp.type_of_service = 0
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].timeo.logout_timeout = 15
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].timeo.login_timeout = 15
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].timeo.auth_timeout = 45
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].timeo.noop_out_interval = 5
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].timeo.noop_out_timeout = 5
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.HeaderDigest = None
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.DataDigest = None
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.IFMarker = No
Sep 04 23:33:20 user nova-compute[72954]: node.conn[0].iscsi.OFMarker = No
Sep 04 23:33:20 user nova-compute[72954]: # END RECORD
Sep 04 23:33:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cc8b8-c6f4-450b-9cac-6954f2d7e4c9]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda77729-3aa3-4cbc-ab1c-988177aae6ec]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpFEGRJe {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpFEGRJe" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490af21-3f93-4ea8-bf2a-56bcb448d149]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpFEGRJe'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c175a8-63e9-4bcb-a488-16fac6c6434d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a44f6f-9aab-4e5f-9783-dc1faf04c0cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] HCTL ('36', '0', '0', 0) found on session 15 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5be976-e732-4ade-9720-e9c2b863f9ee]: (4, ('0 0 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Searching for a device in session 15 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] <== connect_volume: return (207ms) {'type': 'block', 'scsi_wwn': '23830633061633264', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633061633264', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1657404968',display_name='tempest-ServerStableDeviceRescueTest-server-1657404968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1657404968',id=4,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZgh255y/+LXAELpJV7eNBqpVnkHZDK1yywzwTsQ38F6MTWggrZ2S8iEHRQkGkIK43aM6t1SJqJQ3wOSWNVZ/R24frsfkYYdaBGggVzktpIfj2sOEhO9E+pt1BZRxKg0A==',key_name='tempest-keypair-121536044',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de27ffc89c94fce98e145aeab3b1876',ramdisk_id='',reservation_id='r-ll2hgmty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-572734187',owner_user_name='tempest-ServerStableDeviceRescueTest-572734187-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8355bdcc8c74030b0e977319cda578a',uuid=de97c8d3-65e0-4770-bf2b-44d58b5e403e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "vif_mac": "fa:16:3e:26:d9:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converting VIF {"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "vif_mac": "fa:16:3e:26:d9:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'pci_devices' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.objects.base [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Object Instance<de97c8d3-65e0-4770-bf2b-44d58b5e403e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:33:20 user nova-compute[72954]:   <uuid>de97c8d3-65e0-4770-bf2b-44d58b5e403e</uuid>
Sep 04 23:33:20 user nova-compute[72954]:   <name>instance-00000004</name>
Sep 04 23:33:20 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:33:20 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:33:20 user nova-compute[72954]:   <metadata>
Sep 04 23:33:20 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:33:20 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1657404968</nova:name>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:33:20</nova:creationTime>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:33:20 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:33:20 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:owner>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:user uuid="f8355bdcc8c74030b0e977319cda578a">tempest-ServerStableDeviceRescueTest-572734187-project-member</nova:user>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:project uuid="9de27ffc89c94fce98e145aeab3b1876">tempest-ServerStableDeviceRescueTest-572734187</nova:project>
Sep 04 23:33:20 user nova-compute[72954]:       </nova:owner>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:33:20 user nova-compute[72954]:       <nova:ports>
Sep 04 23:33:20 user nova-compute[72954]:         <nova:port uuid="751176c8-9875-4a16-9f95-f0391238238b">
Sep 04 23:33:20 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:33:20 user nova-compute[72954]:         </nova:port>
Sep 04 23:33:20 user nova-compute[72954]:       </nova:ports>
Sep 04 23:33:20 user nova-compute[72954]:     </nova:instance>
Sep 04 23:33:20 user nova-compute[72954]:   </metadata>
Sep 04 23:33:20 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:33:20 user nova-compute[72954]:     <system>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="serial">de97c8d3-65e0-4770-bf2b-44d58b5e403e</entry>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="uuid">de97c8d3-65e0-4770-bf2b-44d58b5e403e</entry>
Sep 04 23:33:20 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:33:20 user nova-compute[72954]:     </system>
Sep 04 23:33:20 user nova-compute[72954]:   </sysinfo>
Sep 04 23:33:20 user nova-compute[72954]:   <os>
Sep 04 23:33:20 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:33:20 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:33:20 user nova-compute[72954]:   </os>
Sep 04 23:33:20 user nova-compute[72954]:   <features>
Sep 04 23:33:20 user nova-compute[72954]:     <acpi/>
Sep 04 23:33:20 user nova-compute[72954]:     <apic/>
Sep 04 23:33:20 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:33:20 user nova-compute[72954]:   </features>
Sep 04 23:33:20 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:33:20 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:33:20 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:33:20 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:33:20 user nova-compute[72954]:   </clock>
Sep 04 23:33:20 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:33:20 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:33:20 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:33:20 user nova-compute[72954]:   </cpu>
Sep 04 23:33:20 user nova-compute[72954]:   <devices>
Sep 04 23:33:20 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:33:20 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:33:20 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk"/>
Sep 04 23:33:20 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:33:20 user nova-compute[72954]:     </disk>
Sep 04 23:33:20 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:33:20 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:33:20 user nova-compute[72954]:       <source dev="/dev/sde"/>
Sep 04 23:33:20 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:33:20 user nova-compute[72954]:       <serial>cfa2fb37-1283-4806-b2e7-e9abc46618aa</serial>
Sep 04 23:33:20 user nova-compute[72954]:     </disk>
Sep 04 23:33:20 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:33:20 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:33:20 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue"/>
Sep 04 23:33:20 user nova-compute[72954]:       <target dev="vdc" bus="virtio"/>
Sep 04 23:33:20 user nova-compute[72954]:       <boot order="1"/>
Sep 04 23:33:20 user nova-compute[72954]:     </disk>
Sep 04 23:33:20 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:33:20 user nova-compute[72954]:       <mac address="fa:16:3e:26:d9:48"/>
Sep 04 23:33:20 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:20 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:33:20 user nova-compute[72954]:       <target dev="tap751176c8-98"/>
Sep 04 23:33:20 user nova-compute[72954]:     </interface>
Sep 04 23:33:20 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:33:20 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/console.log" append="off"/>
Sep 04 23:33:20 user nova-compute[72954]:     </serial>
Sep 04 23:33:20 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:33:20 user nova-compute[72954]:     <video>
Sep 04 23:33:20 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:20 user nova-compute[72954]:     </video>
Sep 04 23:33:20 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:33:20 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:33:20 user nova-compute[72954]:     </rng>
Sep 04 23:33:20 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:33:20 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:33:20 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:33:20 user nova-compute[72954]:     </memballoon>
Sep 04 23:33:20 user nova-compute[72954]:   </devices>
Sep 04 23:33:20 user nova-compute[72954]: </domain>
Sep 04 23:33:20 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:20 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance destroyed successfully.
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] No VIF found with MAC fa:16:3e:26:d9:48, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-changed-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing instance network info cache due to event network-changed-6aebeec6-852d-44a2-9639-b0fbb738b2f2. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] Acquiring lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] Acquired lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Refreshing network info cache for port 6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:33:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updated VIF entry in instance network info cache for port 6aebeec6-852d-44a2-9639-b0fbb738b2f2. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:33:21 user nova-compute[72954]: DEBUG nova.network.neutron [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7140e6ad-b012-4090-a2a9-b9f78d6f6183 req-a6ea38d7-9ce6-42e1-b291-c9a8351c225b service nova] Releasing lock "refresh_cache-621de8a1-f2a6-4337-a53e-6667555c8532" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:22 user nova-compute[72954]: WARNING nova.compute.manager [req-403914c3-4ccb-4166-b1aa-1a7214317cec req-c593602e-7f7b-49a2-ad2c-2698e0c89e6f service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state rescuing.
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:23 user nova-compute[72954]: INFO nova.compute.manager [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Terminating instance
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4de8842-fb55-4127-8dad-c1a814e8fc81 req-4009164a-7ab4-4106-b1b8-0e300ee6745f service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870388.8377993, ffeb12e3-6924-4536-9d90-23064511fee8 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:23 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] VM Stopped (Lifecycle Event)
Sep 04 23:33:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-990ae01d-3de2-473b-9978-66be55ad6543 None None] [instance: ffeb12e3-6924-4536-9d90-23064511fee8] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: WARNING nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state active and task_state rescuing.
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: WARNING nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-6aebeec6-852d-44a2-9639-b0fbb738b2f2 for instance with vm_state active and task_state deleting.
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: WARNING nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-b8aa8333-4263-4ffe-ae0e-6aad0637a809 for instance with vm_state active and task_state deleting.
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-8c7316df-a70d-4e8c-b15a-60dfeaae1971 req-9a4f0839-b43f-436e-b4ce-5f5388055fc3 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bff24f7-38c8-4384-9ecd-817cfb8a6116 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for de97c8d3-65e0-4770-bf2b-44d58b5e403e due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870404.9242651, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:24 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Resumed (Lifecycle Event)
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Instance destroyed successfully.
Sep 04 23:33:24 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lazy-loading 'resources' on Instance uuid 621de8a1-f2a6-4337-a53e-6667555c8532 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:25 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] During sync_power_state the instance has a pending task (rescuing). Skip.
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870404.9244409, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:25 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Started (Lifecycle Event)
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aebeec6-85, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:77:a0,bridge_name='br-int',has_traffic_filtering=True,id=6aebeec6-852d-44a2-9639-b0fbb738b2f2,network=Network(263aca78-46a7-47b6-9dcf-1b6d1ad38709),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aebeec6-85')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd96e99b2-46, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:f2:07,bridge_name='br-int',has_traffic_filtering=True,id=d96e99b2-4640-481b-a8d5-f7c0d2f3d415,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd96e99b2-46')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap151677de-13, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:cf:10,bridge_name='br-int',has_traffic_filtering=True,id=151677de-13d0-4b86-b6b4-3d81a9d3df85,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap151677de-13')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25c6ae47-a0, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:89:08,bridge_name='br-int',has_traffic_filtering=True,id=25c6ae47-a009-4043-8f95-54b1203984d1,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c6ae47-a0')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8aa8333-42, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870390.283942, 6f2dd93c-0564-4e76-8219-a4e5a7aaace5 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:25 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] VM Stopped (Lifecycle Event)
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=b8aa8333-4263-4ffe-ae0e-6aad0637a809,network=Network(bb0b26ef-8aad-4513-8b98-e2ad95443fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8aa8333-42')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb48d974-72, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d5396ebf-281e-454a-9fa5-9dd78048a282 None None] [instance: 6f2dd93c-0564-4e76-8219-a4e5a7aaace5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a2:ab,bridge_name='br-int',has_traffic_filtering=True,id=eb48d974-727f-4842-a1cc-d4e760222a33,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb48d974-72')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1780668482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1780668482',id=11,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHycN8JUXjXDxOT/FMP5dhKO32HUYJaFH9cXAnp4bo4vFYFxAEhjkxiW3GTdfuAl5a3FLxkCqpJqCZy110S0TY/l9uLDPGyKJsUeO4rc/zz8WPpw1L92DomEPC/DQQ98dg==',key_name='tempest-keypair-1517918416',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbd1f98271cc4223905a5e6077a93565',ramdisk_id='',reservation_id='r-fy209va9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-32214521',owner_user_name='tempest-TaggedBootDevicesTest-32214521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='147ef3821ef349929c5bd9d6db7c55d1',uuid=621de8a1-f2a6-4337-a53e-6667555c8532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converting VIF {"id": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "address": "fa:16:3e:ba:b8:8f", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd74083a5-5a", "ovs_interfaceid": "d74083a5-5a71-450c-9dbb-c9f6be72c19d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd74083a5-5a, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: INFO os_vif [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b8:8f,bridge_name='br-int',has_traffic_filtering=True,id=d74083a5-5a71-450c-9dbb-c9f6be72c19d,network=Network(dbb6918b-0969-4929-8461-cf686dbff0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd74083a5-5a')
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDKQhXny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[88022beb-35e4-4c01-8e9c-de7408cce9a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec2d92-cdd9-47a3-b97e-d83cd919445e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183196c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8980928-9b6d-49b7-a318-823cdfb3a42a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6744936-7745-4a6c-90f6-34ed9b3a70d4]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5174d0c-c91b-4dd4-9f1e-da44a2c26294]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b579c0-ee6b-4b7a-ace6-f0cd9e288f60]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7cef24-8031-4d2e-9377-ac227c97c12d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d1ade-915b-489f-b3e6-29b7cdcb87cd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260]
Sep 04 23:33:25 user nova-compute[72954]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c04a2e-92f1-49aa-91f5-e20e20ece04b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efceb7e-88f7-4f78-b1a9-1268dfde0832]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== disconnect_volume: return (336ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADxkMUpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e331ec-a61a-4bc6-9537-bd988e71425a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff766a9-cb75-4bd6-8acc-573c8d5a0022]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11834a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d503d9d9-d336-4da5-b9f8-e0b133439cd4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[420cdfb8-b21f-44cc-a80f-1babcd8ff77d]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aad1c8-fa79-41bf-9a32-2f88ef133ee4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b495bf-de9d-4c6f-bb5b-c288be9eda97]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[468cf522-50e6-40b1-ab28-d65ac692e9f3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d96e99b2-4640-481b-a8d5-f7c0d2f3d415 for instance with vm_state active and task_state deleting.
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-151677de-13d0-4b86-b6b4-3d81a9d3df85 for instance with vm_state active and task_state deleting.
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-25c6ae47-a009-4043-8f95-54b1203984d1 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-25c6ae47-a009-4043-8f95-54b1203984d1 for instance with vm_state active and task_state deleting.
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-unplugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-unplugged-eb48d974-727f-4842-a1cc-d4e760222a33 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:25 user nova-compute[72954]: WARNING nova.compute.manager [req-478ad434-7fe5-485c-b402-739d80f93524 req-6914d7d5-986e-421e-bf09-043ca3898135 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-eb48d974-727f-4842-a1cc-d4e760222a33 for instance with vm_state active and task_state deleting.
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a217a47a-cf75-4631-872e-3ca53e793cb2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260]
Sep 04 23:33:25 user nova-compute[72954]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6f9255-7e73-4740-a359-ca5937d2c5e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6fe9c5-2330-4962-9cff-f279a91a1048]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== disconnect_volume: return (323ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNXatypz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:26 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3be003-6450-4573-98f7-1c6182f41e3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8239912c-b224-4421-b62a-bb4a8eb2f481]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1184ceef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc8f95-8bb0-44db-bede-675402fef29b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1b1f1-2ae3-4cdd-b310-57fbddc1a847]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee3990-728a-474f-9037-5a1aae23dc64]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[62683086-7d6a-4fd4-baf8-10dbcabd9918]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637cf49-8bb7-4100-bf7a-e33a4e6fbb92]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa8dbb-75e5-4080-b91d-00d5338d5793]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260]
Sep 04 23:33:26 user nova-compute[72954]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ef8de5-448a-411c-8307-755659c81fac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4de36f-3452-447a-a13e-0512a013a4de]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] <== disconnect_volume: return (293ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Deleting instance files /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532_del
Sep 04 23:33:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Deletion of /opt/stack/data/nova/instances/621de8a1-f2a6-4337-a53e-6667555c8532_del complete
Sep 04 23:33:26 user nova-compute[72954]: INFO nova.compute.manager [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Took 3.15 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] Acquiring lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] Lock "621de8a1-f2a6-4337-a53e-6667555c8532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] No waiting events found dispatching network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:26 user nova-compute[72954]: WARNING nova.compute.manager [req-4b088b59-2908-4df8-97ec-284e68708756 req-6d906d06-d794-4125-ae8c-d0718a64b81d service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received unexpected event network-vif-plugged-d74083a5-5a71-450c-9dbb-c9f6be72c19d for instance with vm_state active and task_state deleting.
Sep 04 23:33:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-94927408-ecd4-4932-b936-8249ca4d52e5 req-67be550d-55a0-42ec-8e97-e466843a3c74 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-deleted-d74083a5-5a71-450c-9dbb-c9f6be72c19d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:27 user nova-compute[72954]: INFO nova.compute.manager [req-94927408-ecd4-4932-b936-8249ca4d52e5 req-67be550d-55a0-42ec-8e97-e466843a3c74 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Neutron deleted interface d74083a5-5a71-450c-9dbb-c9f6be72c19d; detaching it from the instance and deleting it from the info cache
Sep 04 23:33:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-94927408-ecd4-4932-b936-8249ca4d52e5 req-67be550d-55a0-42ec-8e97-e466843a3c74 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [{"id": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "address": "fa:16:3e:74:77:a0", "network": {"id": "263aca78-46a7-47b6-9dcf-1b6d1ad38709", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1462106222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aebeec6-85", "ovs_interfaceid": "6aebeec6-852d-44a2-9639-b0fbb738b2f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "address": "fa:16:3e:3d:f2:07", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e99b2-46", "ovs_interfaceid": "d96e99b2-4640-481b-a8d5-f7c0d2f3d415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "address": "fa:16:3e:8f:cf:10", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151677de-13", "ovs_interfaceid": "151677de-13d0-4b86-b6b4-3d81a9d3df85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "25c6ae47-a009-4043-8f95-54b1203984d1", "address": "fa:16:3e:40:89:08", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c6ae47-a0", "ovs_interfaceid": "25c6ae47-a009-4043-8f95-54b1203984d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "address": "fa:16:3e:85:15:9d", "network": {"id": "bb0b26ef-8aad-4513-8b98-e2ad95443fe0", "bridge": "br-int", "label": "tempest-device-tagging-net1-618763973", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8aa8333-42", "ovs_interfaceid": "b8aa8333-4263-4ffe-ae0e-6aad0637a809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb48d974-727f-4842-a1cc-d4e760222a33", "address": "fa:16:3e:5d:a2:ab", "network": {"id": "dbb6918b-0969-4929-8461-cf686dbff0a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-918482710", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bbd1f98271cc4223905a5e6077a93565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb48d974-72", "ovs_interfaceid": "eb48d974-727f-4842-a1cc-d4e760222a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-94927408-ecd4-4932-b936-8249ca4d52e5 req-67be550d-55a0-42ec-8e97-e466843a3c74 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Detach interface failed, port_id=d74083a5-5a71-450c-9dbb-c9f6be72c19d, reason: Instance 621de8a1-f2a6-4337-a53e-6667555c8532 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:33:29 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:29 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Took 3.40 seconds to deallocate network for instance.
Sep 04 23:33:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-8dbb4939-b305-4fc0-8cdf-437700c05566 req-7d5103e5-f7f4-4d1e-92f4-497266143ea6 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-deleted-6aebeec6-852d-44a2-9639-b0fbb738b2f2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-8dbb4939-b305-4fc0-8cdf-437700c05566 req-7d5103e5-f7f4-4d1e-92f4-497266143ea6 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-deleted-25c6ae47-a009-4043-8f95-54b1203984d1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-8dbb4939-b305-4fc0-8cdf-437700c05566 req-7d5103e5-f7f4-4d1e-92f4-497266143ea6 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-deleted-b8aa8333-4263-4ffe-ae0e-6aad0637a809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-8dbb4939-b305-4fc0-8cdf-437700c05566 req-7d5103e5-f7f4-4d1e-92f4-497266143ea6 service nova] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Received event network-vif-deleted-eb48d974-727f-4842-a1cc-d4e760222a33 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:31 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870396.510703, 59f79766-4fb0-43e2-9f3e-9eed3d9129bd => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:31 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] VM Stopped (Lifecycle Event)
Sep 04 23:33:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c6440fcc-24c4-4b6d-9675-a6af401aa93f None None] [instance: 59f79766-4fb0-43e2-9f3e-9eed3d9129bd] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:32 user nova-compute[72954]: INFO nova.compute.manager [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Took 2.64 seconds to detach 3 volumes for instance.
Sep 04 23:33:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:32 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Deleted allocations for instance 621de8a1-f2a6-4337-a53e-6667555c8532
Sep 04 23:33:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b5bc5963-fe98-4c7f-9353-6ccb18daccdc tempest-TaggedBootDevicesTest-32214521 tempest-TaggedBootDevicesTest-32214521-project-member] Lock "621de8a1-f2a6-4337-a53e-6667555c8532" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.783s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-changed-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing instance network info cache due to event network-changed-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:33:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] Acquiring lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] Acquired lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Refreshing network info cache for port e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:33:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updated VIF entry in instance network info cache for port e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:33:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-55150370-20c5-4104-be05-c63efda4f3c9 req-b18ec778-9cb5-47f4-acfc-42aa0bed1451 service nova] Releasing lock "refresh_cache-2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:37 user nova-compute[72954]: INFO nova.compute.manager [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Terminating instance
Sep 04 23:33:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1feb0a34-6475-4bcb-ae31-c83da3989f83 req-d30b28a5-f487-44b3-a8a6-a62c914b3f08 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb271a57-cdc6-4585-87e5-fe4bccd11122 req-43df1102-3a1a-4d7a-befc-cba447e28116 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-45a30df0-88bc-4290-87ea-cf1415155d71 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-c3bd075b-6bb4-45a7-8fb4-d9d9ee7cf94b req-5bff799c-21e7-4233-aeba-9b96b173a787 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Instance destroyed successfully.
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lazy-loading 'resources' on Instance uuid 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape008d5a5-4f, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ee:69,bridge_name='br-int',has_traffic_filtering=True,id=e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b,network=Network(50799247-42f4-4e32-8b95-4ded209d9f84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape008d5a5-4f')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb4bc78-e2, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:88:5e,bridge_name='br-int',has_traffic_filtering=True,id=1cb4bc78-e278-4890-a436-2f18e71ce882,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1cb4bc78-e2')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18691478-b1, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:17:0b,bridge_name='br-int',has_traffic_filtering=True,id=18691478-b154-41b4-b40c-6003fc6c4a6a,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18691478-b1')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45a30df0-88, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:d6:55,bridge_name='br-int',has_traffic_filtering=True,id=45a30df0-88bc-4290-87ea-cf1415155d71,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a30df0-88')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "190ad02b-b44c-4060-b923-46b101806751", "address": "fa:16:3e:fe:ca:2c", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap190ad02b-b4", "ovs_interfaceid": "190ad02b-b44c-4060-b923-46b101806751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap190ad02b-b4, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ca:2c,bridge_name='br-int',has_traffic_filtering=True,id=190ad02b-b44c-4060-b923-46b101806751,network=Network(14b2a8f0-5a0d-48d1-b7dc-3857ad580849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap190ad02b-b4')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aa360bc-13, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:6c:51,bridge_name='br-int',has_traffic_filtering=True,id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aa360bc-13')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1671201946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1671201946',id=12,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGyyC7XBneEEDGfjA82jOZ2Rska4nf7PFXz/GLOb5r7YdQ2ngnAU+SiTj0UQMxqqeKU0gvDwAB67XPNGynVqvaTwaD/wquKz2f+CZBalf+quB9iweP3DyEA4YFTjKEFDw==',key_name='tempest-keypair-579068021',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6d70ab74f67414b912af732dc455009',ramdisk_id='',reservation_id='r-2d4f0dj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1424111031',owner_user_name='tempest-TaggedBootDevicesTest_v242-1424111031-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65a8dc3d341a4ed588888bc9fae5c824',uuid=2246c9a2-e6d8-4fd8-bc8b-49351a236b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converting VIF {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc806dbe0-d5, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:39 user nova-compute[72954]: INFO os_vif [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:08:54,bridge_name='br-int',has_traffic_filtering=True,id=c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf,network=Network(c8973594-3427-4c69-8109-7051201a124f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc806dbe0-d5')
Sep 04 23:33:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDyahulx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:39 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8ae651-7b92-43b2-9068-bfdfbc78c1d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d27ed1-363c-4615-b827-fd8ac0d2324f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:39 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118318f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5'): ({'sdf'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Removing single pathed devices sdf {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e84aa40-8120-4e9b-a573-70ded8bf356b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cea804-7e4a-4250-a90c-8fb5d7d81024]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Flushing IO for device /dev/sdf {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064e67c-e9be-4c2b-be82-44f35bb58526]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa078cd2-f974-4840-8447-1de47fda7e97]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] SCSI volumes sdf have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ca5db-b056-40db-8e6f-1d37db3b20b3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[59215e75-f66c-4947-8400-9590a018a3b2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260]
Sep 04 23:33:40 user nova-compute[72954]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89ee2fde-8c12-4f66-bbde-82e45d183ec5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[74668fff-ed7e-4f85-b297-2d560a4158e5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== disconnect_volume: return (292ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870404.990726, 621de8a1-f2a6-4337-a53e-6667555c8532 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:40 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] VM Stopped (Lifecycle Event)
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGyVvLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-147dedff-52f8-4ef2-a12d-e966b020b0fe None None] [instance: 621de8a1-f2a6-4337-a53e-6667555c8532] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dbac41-82eb-4a7e-bfc7-30cf72ca6015]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-1cb4bc78-e278-4890-a436-2f18e71ce882 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-1cb4bc78-e278-4890-a436-2f18e71ce882 for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-18691478-b154-41b4-b40c-6003fc6c4a6a for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-18691478-b154-41b4-b40c-6003fc6c4a6a for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-190ad02b-b44c-4060-b923-46b101806751 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-a8200596-2011-4135-9581-a91af6064213 req-70f232fe-c393-4b75-95d4-7fbcb3588695 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-190ad02b-b44c-4060-b923-46b101806751 for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[39071b3e-952e-41df-aa7b-951a9274b0d4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130318700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248'): ({'sdg'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Removing single pathed devices sdg {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[14068282-95ff-454d-91cf-6fcdec7f7a16]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67b4d8a-58a3-40ed-ad4a-7da7471a2855]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Flushing IO for device /dev/sdg {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1639aec7-a8cf-4110-9602-134fb10100a3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e0c11-b00a-4f4d-ad2a-e9667df11d6b]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] SCSI volumes sdg have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[22243251-3f35-4420-8d14-9239a6e4de96]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb952b4-1873-4aa7-a673-5b176a86425b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260]
Sep 04 23:33:40 user nova-compute[72954]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a2fda0-1b7e-4b6f-a8c0-e66b8500e248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83d941-3b07-4355-8410-e2e262c15284]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== disconnect_volume: return (294ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FosdnNLR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[542034b9-b514-47fb-a804-a16028d5596b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b29f99-2402-4cf3-b91e-65a301eebcc3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:33:40 user nova-compute[72954]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 (non-flash)
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130318700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2'): ({'sdh'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Removing single pathed devices sdh {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf94e55-3d26-489d-ace7-65cb9d5c81f7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f178ab80-353f-4d8a-b026-657fb3a7a639]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Flushing IO for device /dev/sdh {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88bee19-8f28-4a14-8bd8-edb524eacc60]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd1d83-fb6c-4999-bd06-68c259e0b80c]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] SCSI volumes sdh have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6f8dc-e6f3-466d-bb5f-54ec8c867b84]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-45a30df0-88bc-4290-87ea-cf1415155d71 for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-unplugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-unplugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-37c75e8a-e048-4d20-b2dc-d8333acbb4e7 req-fe852d66-866b-49ff-9a1a-136b830a0769 service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf692d8-5d7a-418e-b728-3da690ca9bb3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260]
Sep 04 23:33:40 user nova-compute[72954]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2, portal: 172.16.0.220,3260] successful.
Sep 04 23:33:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f5baaf7-e250-4292-9001-458dea30cda2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2944f-2b5a-4df0-88af-3f0c6b729c19]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] <== disconnect_volume: return (265ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:33:40 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Deleting instance files /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f_del
Sep 04 23:33:40 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Deletion of /opt/stack/data/nova/instances/2246c9a2-e6d8-4fd8-bc8b-49351a236b2f_del complete
Sep 04 23:33:40 user nova-compute[72954]: INFO nova.compute.manager [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Took 3.02 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] Acquiring lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] No waiting events found dispatching network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:40 user nova-compute[72954]: WARNING nova.compute.manager [req-22f70ef1-17ac-40a0-9eb1-4a141f8182fd req-4f4a049e-5553-4dbb-b8cf-9e94ce0c356c service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received unexpected event network-vif-plugged-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf for instance with vm_state active and task_state deleting.
Sep 04 23:33:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-deleted-190ad02b-b44c-4060-b923-46b101806751 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:42 user nova-compute[72954]: INFO nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Neutron deleted interface 190ad02b-b44c-4060-b923-46b101806751; detaching it from the instance and deleting it from the info cache
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "address": "fa:16:3e:b3:6c:51", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aa360bc-13", "ovs_interfaceid": "2aa360bc-13ab-44ad-9d58-eb5171d0c5cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Detach interface failed, port_id=190ad02b-b44c-4060-b923-46b101806751, reason: Instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-deleted-2aa360bc-13ab-44ad-9d58-eb5171d0c5cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:42 user nova-compute[72954]: INFO nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Neutron deleted interface 2aa360bc-13ab-44ad-9d58-eb5171d0c5cf; detaching it from the instance and deleting it from the info cache
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [{"id": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "address": "fa:16:3e:78:ee:69", "network": {"id": "50799247-42f4-4e32-8b95-4ded209d9f84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1216072030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape008d5a5-4f", "ovs_interfaceid": "e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1cb4bc78-e278-4890-a436-2f18e71ce882", "address": "fa:16:3e:45:88:5e", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.84", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb4bc78-e2", "ovs_interfaceid": "1cb4bc78-e278-4890-a436-2f18e71ce882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18691478-b154-41b4-b40c-6003fc6c4a6a", "address": "fa:16:3e:4a:17:0b", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18691478-b1", "ovs_interfaceid": "18691478-b154-41b4-b40c-6003fc6c4a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45a30df0-88bc-4290-87ea-cf1415155d71", "address": "fa:16:3e:86:d6:55", "network": {"id": "14b2a8f0-5a0d-48d1-b7dc-3857ad580849", "bridge": "br-int", "label": "tempest-device-tagging-net1-977738252", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a30df0-88", "ovs_interfaceid": "45a30df0-88bc-4290-87ea-cf1415155d71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "address": "fa:16:3e:df:08:54", "network": {"id": "c8973594-3427-4c69-8109-7051201a124f", "bridge": "br-int", "label": "tempest-device-tagging-net2-725907447", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e6d70ab74f67414b912af732dc455009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc806dbe0-d5", "ovs_interfaceid": "c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-3fb6b756-9516-45c3-8081-fbf20ea30d64 req-3c05662e-8e60-4517-9170-d979f2ff35df service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Detach interface failed, port_id=2aa360bc-13ab-44ad-9d58-eb5171d0c5cf, reason: Instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:33:43 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:43 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Took 2.81 seconds to deallocate network for instance.
Sep 04 23:33:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-14c37ecc-8a08-4201-894e-a0882f4d035a req-6c36e37a-8d36-49d6-90f1-aa0e114dc2dc service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-deleted-45a30df0-88bc-4290-87ea-cf1415155d71 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-14c37ecc-8a08-4201-894e-a0882f4d035a req-6c36e37a-8d36-49d6-90f1-aa0e114dc2dc service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-deleted-c806dbe0-d5e1-4e00-a51f-9d14ebf00fcf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-14c37ecc-8a08-4201-894e-a0882f4d035a req-6c36e37a-8d36-49d6-90f1-aa0e114dc2dc service nova] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Received event network-vif-deleted-e008d5a5-4fc5-4d94-83b4-5d6dbf957b7b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:46 user nova-compute[72954]: INFO nova.compute.manager [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Took 2.94 seconds to detach 3 volumes for instance.
Sep 04 23:33:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:46 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Deleted allocations for instance 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f
Sep 04 23:33:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-885e0b0c-e32b-494f-9903-07fd116abea7 tempest-TaggedBootDevicesTest_v242-1424111031 tempest-TaggedBootDevicesTest_v242-1424111031-project-member] Lock "2246c9a2-e6d8-4fd8-bc8b-49351a236b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.329s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:48 user nova-compute[72954]: INFO nova.compute.manager [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Terminating instance
Sep 04 23:33:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-unplugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] No waiting events found dispatching network-vif-unplugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-2c7e5442-1e4b-49cf-89cd-9d3c1ccf6459 req-c2ed45dd-88a4-43fc-a247-7deab4849658 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-unplugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:33:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Instance destroyed successfully.
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lazy-loading 'resources' on Instance uuid e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1088114313',display_name='tempest-TestVolumeSwap-server-1088114313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1088114313',id=7,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLagqR3MgukgSt69vNRIhsCMWjRQ6aWCAUl8aNOjwEbd0qowwbzpSEx/ECnd/dvGfCeAYn4pePff86iLmUu4GEEHPApbjtxHn6TqEo0ZqYnON2E1IVfR7r2zvz1kf+NfFg==',key_name='tempest-keypair-99913944',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3334f294cb3444ca934331e740d20ea3',ramdisk_id='',reservation_id='r-3c5uvq0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1259080742',owner_user_name='tempest-TestVolumeSwap-1259080742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='050fb22bcc8d4fdf99e1857e1d232cac',uuid=e4b9dde7-133f-4f2a-b2e4-6cdafb61db98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converting VIF {"id": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "address": "fa:16:3e:80:80:b1", "network": {"id": "5390747d-ba48-4dab-b829-3f486a95375c", "bridge": "br-int", "label": "tempest-TestVolumeSwap-764797278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3334f294cb3444ca934331e740d20ea3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae69a72e-e5", "ovs_interfaceid": "ae69a72e-e5a1-4294-ab47-343a59702ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG os_vif [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae69a72e-e5, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:33:49 user nova-compute[72954]: INFO os_vif [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:80:b1,bridge_name='br-int',has_traffic_filtering=True,id=ae69a72e-e5a1-4294-ab47-343a59702ee3,network=Network(5390747d-ba48-4dab-b829-3f486a95375c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae69a72e-e5')
Sep 04 23:33:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Deleting instance files /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98_del
Sep 04 23:33:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Deletion of /opt/stack/data/nova/instances/e4b9dde7-133f-4f2a-b2e4-6cdafb61db98_del complete
Sep 04 23:33:49 user nova-compute[72954]: INFO nova.compute.manager [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Took 0.88 seconds to destroy the instance on the hypervisor.
Sep 04 23:33:49 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:33:49 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:50 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Took 0.73 seconds to deallocate network for instance.
Sep 04 23:33:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-7be71e55-54fb-4dc9-b182-5a2dad8d2640 req-0bbcd84b-ed47-4303-95f7-d84e213abaf8 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-deleted-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:50 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Deleted allocations for instance e4b9dde7-133f-4f2a-b2e4-6cdafb61db98
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ad7c2705-a6f5-445a-bf8b-b35cb1bf0694 tempest-TestVolumeSwap-1259080742 tempest-TestVolumeSwap-1259080742-project-member] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] Acquiring lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] Lock "e4b9dde7-133f-4f2a-b2e4-6cdafb61db98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] No waiting events found dispatching network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:50 user nova-compute[72954]: WARNING nova.compute.manager [req-4699198e-1a8a-4e37-8b54-82f9da070116 req-f15603ca-01df-4537-96a3-497091cfe898 service nova] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Received unexpected event network-vif-plugged-ae69a72e-e5a1-4294-ab47-343a59702ee3 for instance with vm_state deleted and task_state None.
Sep 04 23:33:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:54 user nova-compute[72954]: INFO nova.compute.manager [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Rescuing
Sep 04 23:33:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870419.4557786, 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:54 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] VM Stopped (Lifecycle Event)
Sep 04 23:33:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65a4bc93-e1f1-415a-9bb0-04e9595a8250 None None] [instance: 2246c9a2-e6d8-4fd8-bc8b-49351a236b2f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:55 user nova-compute[72954]: WARNING nova.compute.manager [req-a4dfcffb-b686-4c7d-893d-0f183cfc09ea req-73065349-5cdd-4924-af14-7a9ddc2069fb service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state rescuing.
Sep 04 23:33:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance destroyed successfully.
Sep 04 23:33:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Attempting rescue
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72954) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:33:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Creating image(s)
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.169s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue" returned: 0 in 0.054s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'migration_context' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.base [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<09afe965-5ce9-43b6-83f7-f0e378ef33e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start _get_guest_xml network_info=[{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:19:68:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.base [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<09afe965-5ce9-43b6-83f7-f0e378ef33e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'numa_topology' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.base [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<09afe965-5ce9-43b6-83f7-f0e378ef33e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:55 user nova-compute[72954]: DEBUG nova.objects.base [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<09afe965-5ce9-43b6-83f7-f0e378ef33e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-971205064',display_name='tempest-ServerRescueNegativeTestJSON-server-971205064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-971205064',id=1,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-eaz8vxab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:29:24Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=09afe965-5ce9-43b6-83f7-f0e378ef33e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:19:68:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:19:68:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.objects.base [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<09afe965-5ce9-43b6-83f7-f0e378ef33e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:33:56 user nova-compute[72954]:   <uuid>09afe965-5ce9-43b6-83f7-f0e378ef33e9</uuid>
Sep 04 23:33:56 user nova-compute[72954]:   <name>instance-00000001</name>
Sep 04 23:33:56 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:33:56 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:33:56 user nova-compute[72954]:   <metadata>
Sep 04 23:33:56 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:33:56 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-971205064</nova:name>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:33:55</nova:creationTime>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:33:56 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:33:56 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:owner>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:33:56 user nova-compute[72954]:       </nova:owner>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:33:56 user nova-compute[72954]:       <nova:ports>
Sep 04 23:33:56 user nova-compute[72954]:         <nova:port uuid="11b998d2-ca1a-47a1-8b34-3b23dc55a938">
Sep 04 23:33:56 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 04 23:33:56 user nova-compute[72954]:         </nova:port>
Sep 04 23:33:56 user nova-compute[72954]:       </nova:ports>
Sep 04 23:33:56 user nova-compute[72954]:     </nova:instance>
Sep 04 23:33:56 user nova-compute[72954]:   </metadata>
Sep 04 23:33:56 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:33:56 user nova-compute[72954]:     <system>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="serial">09afe965-5ce9-43b6-83f7-f0e378ef33e9</entry>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="uuid">09afe965-5ce9-43b6-83f7-f0e378ef33e9</entry>
Sep 04 23:33:56 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:33:56 user nova-compute[72954]:     </system>
Sep 04 23:33:56 user nova-compute[72954]:   </sysinfo>
Sep 04 23:33:56 user nova-compute[72954]:   <os>
Sep 04 23:33:56 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:33:56 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:33:56 user nova-compute[72954]:   </os>
Sep 04 23:33:56 user nova-compute[72954]:   <features>
Sep 04 23:33:56 user nova-compute[72954]:     <acpi/>
Sep 04 23:33:56 user nova-compute[72954]:     <apic/>
Sep 04 23:33:56 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:33:56 user nova-compute[72954]:   </features>
Sep 04 23:33:56 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:33:56 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:33:56 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:33:56 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:33:56 user nova-compute[72954]:   </clock>
Sep 04 23:33:56 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:33:56 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:33:56 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:33:56 user nova-compute[72954]:   </cpu>
Sep 04 23:33:56 user nova-compute[72954]:   <devices>
Sep 04 23:33:56 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:33:56 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:33:56 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue"/>
Sep 04 23:33:56 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:33:56 user nova-compute[72954]:     </disk>
Sep 04 23:33:56 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:33:56 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:33:56 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk"/>
Sep 04 23:33:56 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:33:56 user nova-compute[72954]:     </disk>
Sep 04 23:33:56 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:33:56 user nova-compute[72954]:       <mac address="fa:16:3e:19:68:33"/>
Sep 04 23:33:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:56 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:33:56 user nova-compute[72954]:       <target dev="tap11b998d2-ca"/>
Sep 04 23:33:56 user nova-compute[72954]:     </interface>
Sep 04 23:33:56 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:33:56 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/console.log" append="off"/>
Sep 04 23:33:56 user nova-compute[72954]:     </serial>
Sep 04 23:33:56 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:33:56 user nova-compute[72954]:     <video>
Sep 04 23:33:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:33:56 user nova-compute[72954]:     </video>
Sep 04 23:33:56 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:33:56 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:33:56 user nova-compute[72954]:     </rng>
Sep 04 23:33:56 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:33:56 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:33:56 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:33:56 user nova-compute[72954]:     </memballoon>
Sep 04 23:33:56 user nova-compute[72954]:   </devices>
Sep 04 23:33:56 user nova-compute[72954]: </domain>
Sep 04 23:33:56 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:33:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance destroyed successfully.
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:33:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:19:68:33, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:57 user nova-compute[72954]: WARNING nova.compute.manager [req-c76a008c-ec79-48b9-9220-fa4eedd4fae5 req-8113790f-79fe-4fb1-9aaa-6733d1a25e1b service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state rescuing.
Sep 04 23:33:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:59 user nova-compute[72954]: WARNING nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state rescuing.
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:33:59 user nova-compute[72954]: WARNING nova.compute.manager [req-80392064-3066-4a09-8b77-24034827ce7a req-da6e08fd-1bc6-442c-8bb4-1095f1eaf0bf service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state active and task_state rescuing.
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for 09afe965-5ce9-43b6-83f7-f0e378ef33e9 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870439.637887, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Resumed (Lifecycle Event)
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a521186f-1875-413f-a282-53855c238eb9 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870439.6453407, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:33:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Started (Lifecycle Event)
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:33:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:33:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Sep 04 23:34:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:02 user nova-compute[72954]: INFO nova.compute.manager [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Rescuing
Sep 04 23:34:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:34:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:03 user nova-compute[72954]: WARNING nova.compute.manager [req-27442b9b-9569-430a-a9cc-0587c07659ee req-b781c856-a4be-4628-8c8a-bc0bd7093963 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state active and task_state rescuing.
Sep 04 23:34:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance destroyed successfully.
Sep 04 23:34:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Attempting a stable device rescue
Sep 04 23:34:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72954) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:34:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Creating image(s)
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "068c90afba49c28fce0903b062517cd0d3b7e87c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "068c90afba49c28fce0903b062517cd0d3b7e87c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870429.1732037, e4b9dde7-133f-4f2a-b2e4-6cdafb61db98 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:05 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] VM Stopped (Lifecycle Event)
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-27a8aebd-df7b-4ef5-a9ee-797069f639ce None None] [instance: e4b9dde7-133f-4f2a-b2e4-6cdafb61db98] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.part --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.virt.images [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] d422f8a6-5386-4aed-8130-39beb7e846b1 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.part /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:05 user nova-compute[72954]: WARNING nova.compute.manager [req-6dbe7f03-9f33-4257-9dae-47dc2812a98f req-35962641-57d3-40c4-9238-bd5de6d2e91c service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state active and task_state rescuing.
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.part /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.converted" returned: 0 in 0.398s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "068c90afba49c28fce0903b062517cd0d3b7e87c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.064s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "068c90afba49c28fce0903b062517cd0d3b7e87c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "068c90afba49c28fce0903b062517cd0d3b7e87c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:34:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c,backing_fmt=raw /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c,backing_fmt=raw /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue" returned: 0 in 0.079s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "068c90afba49c28fce0903b062517cd0d3b7e87c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'migration_context' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Object Instance<2e25e677-e6be-43ef-9663-6c6fdeddf302> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start _get_guest_xml network_info=[{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "vif_mac": "fa:16:3e:4b:cb:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd422f8a6-5386-4aed-8130-39beb7e846b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '2e25e677-e6be-43ef-9663-6c6fdeddf302', 'attached_at': '', 'detached_at': '', 'volume_id': '96933111-ff82-4d21-a7e8-79822ca9489d', 'serial': '96933111-ff82-4d21-a7e8-79822ca9489d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'cff98b9e-0979-47ac-af48-50e61b1481f6', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'resources' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Object Instance<2e25e677-e6be-43ef-9663-6c6fdeddf302> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Object Instance<2e25e677-e6be-43ef-9663-6c6fdeddf302> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:34:06 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:06 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Object Instance<2e25e677-e6be-43ef-9663-6c6fdeddf302> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:34:06 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:34:06 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:34:06 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d6e6ba-56bc-4d4b-8616-1d3ea5955f3a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rsukmZjb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Sep 04 23:34:06 user nova-compute[72954]: node.name = iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d
Sep 04 23:34:06 user nova-compute[72954]: node.tpgt = -1
Sep 04 23:34:06 user nova-compute[72954]: node.startup = automatic
Sep 04 23:34:06 user nova-compute[72954]: node.leading_login = No
Sep 04 23:34:06 user nova-compute[72954]: iface.iscsi_ifacename = default
Sep 04 23:34:06 user nova-compute[72954]: iface.net_ifacename = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.ipaddress = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.prefix_len = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.hwaddress = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.transport_name = tcp
Sep 04 23:34:06 user nova-compute[72954]: iface.initiatorname = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.vlan_id = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.vlan_priority = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.vlan_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.iface_num = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.mtu = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.port = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.bootproto = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.subnet_mask = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.gateway = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_alt_client_id_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_alt_client_id = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_dns = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_learn_iqn = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_req_vendor_id_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_vendor_id_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_vendor_id = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.dhcp_slp_da = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.fragmentation = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.gratuitous_arp = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.incoming_forwarding = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.tos_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.tos = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.ttl = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.delayed_ack = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.tcp_nagle = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.tcp_wsf_state = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.tcp_wsf = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.tcp_timer_scale = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.tcp_timestamp = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.redirect = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.def_task_mgmt_timeout = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.header_digest = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.data_digest = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.immediate_data = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.initial_r2t = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.data_seq_inorder = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.data_pdu_inorder = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.erl = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.max_receive_data_len = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.first_burst_len = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.max_outstanding_r2t = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.max_burst_len = 0
Sep 04 23:34:06 user nova-compute[72954]: iface.chap_auth = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.bidi_chap = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.strict_login_compliance = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.discovery_auth = <empty>
Sep 04 23:34:06 user nova-compute[72954]: iface.discovery_logout = <empty>
Sep 04 23:34:06 user nova-compute[72954]: node.discovery_address = <empty>
Sep 04 23:34:06 user nova-compute[72954]: node.discovery_port = 0
Sep 04 23:34:06 user nova-compute[72954]: node.discovery_type = static
Sep 04 23:34:06 user nova-compute[72954]: node.session.initial_cmdsn = 0
Sep 04 23:34:06 user nova-compute[72954]: node.session.initial_login_retry_max = 8
Sep 04 23:34:06 user nova-compute[72954]: node.session.xmit_thread_priority = -20
Sep 04 23:34:06 user nova-compute[72954]: node.session.cmds_max = 128
Sep 04 23:34:06 user nova-compute[72954]: node.session.queue_depth = 32
Sep 04 23:34:06 user nova-compute[72954]: node.session.nr_sessions = 1
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.authmethod = CHAP
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.username = rsukmZjb
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.password = ***
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.username_in = <empty>
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.password_in = <empty>
Sep 04 23:34:06 user nova-compute[72954]: node.session.auth.chap_algs = MD5
Sep 04 23:34:06 user nova-compute[72954]: node.session.timeo.replacement_timeout = 120
Sep 04 23:34:06 user nova-compute[72954]: node.session.err_timeo.abort_timeout = 15
Sep 04 23:34:06 user nova-compute[72954]: node.session.err_timeo.lu_reset_timeout = 30
Sep 04 23:34:06 user nova-compute[72954]: node.session.err_timeo.tgt_reset_timeout = 30
Sep 04 23:34:06 user nova-compute[72954]: node.session.err_timeo.host_reset_timeout = 60
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.FastAbort = Yes
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.InitialR2T = No
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.ImmediateData = Yes
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.FirstBurstLength = 262144
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.MaxBurstLength = 16776192
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.DefaultTime2Retain = 0
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.DefaultTime2Wait = 2
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.MaxConnections = 1
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.MaxOutstandingR2T = 1
Sep 04 23:34:06 user nova-compute[72954]: node.session.iscsi.ERL = 0
Sep 04 23:34:06 user nova-compute[72954]: node.session.scan = manual
Sep 04 23:34:06 user nova-compute[72954]: node.session.reopen_max = 0
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].address = 172.16.0.220
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].port = 3260
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].startup = manual
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].tcp.window_size = 524288
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].tcp.type_of_service = 0
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].timeo.logout_timeout = 15
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].timeo.login_timeout = 15
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].timeo.auth_timeout = 45
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].timeo.noop_out_interval = 5
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].timeo.noop_out_timeout = 5
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.HeaderDigest = None
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.DataDigest = None
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.IFMarker = No
Sep 04 23:34:06 user nova-compute[72954]: node.conn[0].iscsi.OFMarker = No
Sep 04 23:34:06 user nova-compute[72954]: # END RECORD
Sep 04 23:34:06 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b22dc-66f8-407a-aa6c-e83ccb10e5b0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7814a8e2-3802-4997-8eac-2b2403881d09]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsukmZjb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rsukmZjb" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e32dce-f447-4757-ae97-a04b196c0e18]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rsukmZjb'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78c05e-92d0-404c-9c4e-b898d1414be7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f17dee-3450-46ba-94da-9d783cb927f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:34:06 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:34:06 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:34:06 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:34:06 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] HCTL ('40', '0', '0', 0) found on session 13 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9807baf-05f9-4d06-86f8-3c61f4df88c9]: (4, ('0 0 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching for a device in session 13 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '23762623763333339', 'path': '/dev/sdi'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762623763333339', 'path': '/dev/sdi'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1198513030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1198513030',id=14,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:32:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5i7yepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:32:40Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=2e25e677-e6be-43ef-9663-6c6fdeddf302,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "vif_mac": "fa:16:3e:4b:cb:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "vif_mac": "fa:16:3e:4b:cb:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.objects.base [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Object Instance<2e25e677-e6be-43ef-9663-6c6fdeddf302> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:34:06 user nova-compute[72954]:   <uuid>2e25e677-e6be-43ef-9663-6c6fdeddf302</uuid>
Sep 04 23:34:06 user nova-compute[72954]:   <name>instance-0000000e</name>
Sep 04 23:34:06 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:34:06 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:34:06 user nova-compute[72954]:   <metadata>
Sep 04 23:34:06 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:34:06 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1198513030</nova:name>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:34:06</nova:creationTime>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:34:06 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:34:06 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:owner>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:user uuid="9f90f45a06454ddaa392e6cbfe58eeca">tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member</nova:user>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:project uuid="cf4c625d90e54690b8cbb9d0c4cd6e54">tempest-ServerBootFromVolumeStableRescueTest-974522082</nova:project>
Sep 04 23:34:06 user nova-compute[72954]:       </nova:owner>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:34:06 user nova-compute[72954]:       <nova:ports>
Sep 04 23:34:06 user nova-compute[72954]:         <nova:port uuid="9dc15794-54ed-4c11-a4d7-76c4c3f2b92c">
Sep 04 23:34:06 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Sep 04 23:34:06 user nova-compute[72954]:         </nova:port>
Sep 04 23:34:06 user nova-compute[72954]:       </nova:ports>
Sep 04 23:34:06 user nova-compute[72954]:     </nova:instance>
Sep 04 23:34:06 user nova-compute[72954]:   </metadata>
Sep 04 23:34:06 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:34:06 user nova-compute[72954]:     <system>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="serial">2e25e677-e6be-43ef-9663-6c6fdeddf302</entry>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="uuid">2e25e677-e6be-43ef-9663-6c6fdeddf302</entry>
Sep 04 23:34:06 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:34:06 user nova-compute[72954]:     </system>
Sep 04 23:34:06 user nova-compute[72954]:   </sysinfo>
Sep 04 23:34:06 user nova-compute[72954]:   <os>
Sep 04 23:34:06 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:34:06 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:34:06 user nova-compute[72954]:   </os>
Sep 04 23:34:06 user nova-compute[72954]:   <features>
Sep 04 23:34:06 user nova-compute[72954]:     <acpi/>
Sep 04 23:34:06 user nova-compute[72954]:     <apic/>
Sep 04 23:34:06 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:34:06 user nova-compute[72954]:   </features>
Sep 04 23:34:06 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:34:06 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:34:06 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:34:06 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:34:06 user nova-compute[72954]:   </clock>
Sep 04 23:34:06 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:34:06 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:34:06 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:34:06 user nova-compute[72954]:   </cpu>
Sep 04 23:34:06 user nova-compute[72954]:   <devices>
Sep 04 23:34:06 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:34:06 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:34:06 user nova-compute[72954]:       <source dev="/dev/sdi"/>
Sep 04 23:34:06 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:34:06 user nova-compute[72954]:       <serial>96933111-ff82-4d21-a7e8-79822ca9489d</serial>
Sep 04 23:34:06 user nova-compute[72954]:     </disk>
Sep 04 23:34:06 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:34:06 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:34:06 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue"/>
Sep 04 23:34:06 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:34:06 user nova-compute[72954]:       <boot order="1"/>
Sep 04 23:34:06 user nova-compute[72954]:     </disk>
Sep 04 23:34:06 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:34:06 user nova-compute[72954]:       <mac address="fa:16:3e:4b:cb:d8"/>
Sep 04 23:34:06 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:06 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:34:06 user nova-compute[72954]:       <target dev="tap9dc15794-54"/>
Sep 04 23:34:06 user nova-compute[72954]:     </interface>
Sep 04 23:34:06 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:34:06 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/console.log" append="off"/>
Sep 04 23:34:06 user nova-compute[72954]:     </serial>
Sep 04 23:34:06 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:34:06 user nova-compute[72954]:     <video>
Sep 04 23:34:06 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:06 user nova-compute[72954]:     </video>
Sep 04 23:34:06 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:34:06 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:34:06 user nova-compute[72954]:     </rng>
Sep 04 23:34:06 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:34:06 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:34:06 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:34:06 user nova-compute[72954]:     </memballoon>
Sep 04 23:34:06 user nova-compute[72954]:   </devices>
Sep 04 23:34:06 user nova-compute[72954]: </domain>
Sep 04 23:34:06 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:34:06 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance destroyed successfully.
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No VIF found with MAC fa:16:3e:4b:cb:d8, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:08 user nova-compute[72954]: WARNING nova.compute.manager [req-7571b0d1-27fa-4a15-b4c6-a0f27f5683a5 req-92af09ed-4c1f-4a0d-a92f-4a4a350cc550 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state active and task_state rescuing.
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for 2e25e677-e6be-43ef-9663-6c6fdeddf302 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870450.4999614, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:10 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Resumed (Lifecycle Event)
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-61eb501f-aa40-4582-a473-ba380a28918e tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:10 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] During sync_power_state the instance has a pending task (rescuing). Skip.
Sep 04 23:34:10 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870450.5158536, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:10 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Started (Lifecycle Event)
Sep 04 23:34:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:11 user nova-compute[72954]: WARNING nova.compute.manager [req-3cf858a7-6e2c-4b08-b4af-ed9849705e08 req-43456974-a320-4408-870c-225c04d1e238 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state rescued and task_state None.
Sep 04 23:34:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=25.21328353881836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:34:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:34:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:34:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:34:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:34:24 user nova-compute[72954]: INFO nova.compute.claims [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Claim successful on node user
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:34:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.policy [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c212fe7f0bd47eea32cf25d5d7e71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2376c60a7a4de5b98eecdbe43a9b47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:34:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Creating image(s)
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "/opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "/opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "/opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.212s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk 1073741824" returned: 0 in 0.074s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Successfully created port: dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Cannot resize image /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Ensure instance console log exists: /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Successfully updated port: dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquired lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-changed-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Refreshing instance network info cache due to event network-changed-dd341f02-68bd-4220-aa11-72992cad137e. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] Acquiring lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updating instance_info_cache with network_info: [{"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Releasing lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Instance network_info: |[{"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] Acquired lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Refreshing network info cache for port dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Start _get_guest_xml network_info=[{"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-64698131',display_name='tempest-DeleteServersTestJSON-server-64698131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-64698131',id=17,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f2376c60a7a4de5b98eecdbe43a9b47',ramdisk_id='',reservation_id='r-nlo1sfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2101815773',owner_user_name='tempest-DeleteServersTestJSON-2101815773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:25Z,user_data=None,user_id='0c212fe7f0bd47eea32cf25d5d7e71fb',uuid=56c16673-4ee4-41fe-a0a5-e92145477f66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converting VIF {"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.objects.instance [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lazy-loading 'pci_devices' on Instance uuid 56c16673-4ee4-41fe-a0a5-e92145477f66 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:34:27 user nova-compute[72954]:   <uuid>56c16673-4ee4-41fe-a0a5-e92145477f66</uuid>
Sep 04 23:34:27 user nova-compute[72954]:   <name>instance-00000011</name>
Sep 04 23:34:27 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:34:27 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:34:27 user nova-compute[72954]:   <metadata>
Sep 04 23:34:27 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:34:27 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:name>tempest-DeleteServersTestJSON-server-64698131</nova:name>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:34:27</nova:creationTime>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:34:27 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:34:27 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:owner>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:user uuid="0c212fe7f0bd47eea32cf25d5d7e71fb">tempest-DeleteServersTestJSON-2101815773-project-member</nova:user>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:project uuid="8f2376c60a7a4de5b98eecdbe43a9b47">tempest-DeleteServersTestJSON-2101815773</nova:project>
Sep 04 23:34:27 user nova-compute[72954]:       </nova:owner>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:34:27 user nova-compute[72954]:       <nova:ports>
Sep 04 23:34:27 user nova-compute[72954]:         <nova:port uuid="dd341f02-68bd-4220-aa11-72992cad137e">
Sep 04 23:34:27 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Sep 04 23:34:27 user nova-compute[72954]:         </nova:port>
Sep 04 23:34:27 user nova-compute[72954]:       </nova:ports>
Sep 04 23:34:27 user nova-compute[72954]:     </nova:instance>
Sep 04 23:34:27 user nova-compute[72954]:   </metadata>
Sep 04 23:34:27 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:34:27 user nova-compute[72954]:     <system>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="serial">56c16673-4ee4-41fe-a0a5-e92145477f66</entry>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="uuid">56c16673-4ee4-41fe-a0a5-e92145477f66</entry>
Sep 04 23:34:27 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:34:27 user nova-compute[72954]:     </system>
Sep 04 23:34:27 user nova-compute[72954]:   </sysinfo>
Sep 04 23:34:27 user nova-compute[72954]:   <os>
Sep 04 23:34:27 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:34:27 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:34:27 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:34:27 user nova-compute[72954]:   </os>
Sep 04 23:34:27 user nova-compute[72954]:   <features>
Sep 04 23:34:27 user nova-compute[72954]:     <acpi/>
Sep 04 23:34:27 user nova-compute[72954]:     <apic/>
Sep 04 23:34:27 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:34:27 user nova-compute[72954]:   </features>
Sep 04 23:34:27 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:34:27 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:34:27 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:34:27 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:34:27 user nova-compute[72954]:   </clock>
Sep 04 23:34:27 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:34:27 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:34:27 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:34:27 user nova-compute[72954]:   </cpu>
Sep 04 23:34:27 user nova-compute[72954]:   <devices>
Sep 04 23:34:27 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:34:27 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:34:27 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk"/>
Sep 04 23:34:27 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:34:27 user nova-compute[72954]:     </disk>
Sep 04 23:34:27 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:34:27 user nova-compute[72954]:       <mac address="fa:16:3e:44:71:e1"/>
Sep 04 23:34:27 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:27 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:34:27 user nova-compute[72954]:       <target dev="tapdd341f02-68"/>
Sep 04 23:34:27 user nova-compute[72954]:     </interface>
Sep 04 23:34:27 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:34:27 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/console.log" append="off"/>
Sep 04 23:34:27 user nova-compute[72954]:     </serial>
Sep 04 23:34:27 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:34:27 user nova-compute[72954]:     <video>
Sep 04 23:34:27 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:27 user nova-compute[72954]:     </video>
Sep 04 23:34:27 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:34:27 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:34:27 user nova-compute[72954]:     </rng>
Sep 04 23:34:27 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:34:27 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:34:27 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:34:27 user nova-compute[72954]:     </memballoon>
Sep 04 23:34:27 user nova-compute[72954]:   </devices>
Sep 04 23:34:27 user nova-compute[72954]: </domain>
Sep 04 23:34:27 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-64698131',display_name='tempest-DeleteServersTestJSON-server-64698131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-64698131',id=17,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f2376c60a7a4de5b98eecdbe43a9b47',ramdisk_id='',reservation_id='r-nlo1sfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2101815773',owner_user_name='tempest-DeleteServersTestJSON-2101815773-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:25Z,user_data=None,user_id='0c212fe7f0bd47eea32cf25d5d7e71fb',uuid=56c16673-4ee4-41fe-a0a5-e92145477f66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converting VIF {"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG os_vif [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd341f02-68, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd341f02-68, col_values=(('external_ids', {'iface-id': 'dd341f02-68bd-4220-aa11-72992cad137e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:71:e1', 'vm-uuid': '56c16673-4ee4-41fe-a0a5-e92145477f66'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:27 user nova-compute[72954]: INFO os_vif [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68')
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] No VIF found with MAC fa:16:3e:44:71:e1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updated VIF entry in instance network info cache for port dd341f02-68bd-4220-aa11-72992cad137e. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updating instance_info_cache with network_info: [{"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d20b933-a1e2-4525-a95a-5df6b26331da req-383ae513-a7e3-4561-b102-1747d9c21956 service nova] Releasing lock "refresh_cache-56c16673-4ee4-41fe-a0a5-e92145477f66" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] No waiting events found dispatching network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:29 user nova-compute[72954]: WARNING nova.compute.manager [req-fb7b4079-32b4-46ac-a731-3e8af864ac16 req-49277d71-e877-4c99-8734-3e91524715b9 service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received unexpected event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e for instance with vm_state building and task_state spawning.
Sep 04 23:34:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870471.097103, 56c16673-4ee4-41fe-a0a5-e92145477f66 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] VM Resumed (Lifecycle Event)
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Instance spawned successfully.
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870471.0991552, 56c16673-4ee4-41fe-a0a5-e92145477f66 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] VM Started (Lifecycle Event)
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Took 6.29 seconds to spawn the instance on the hypervisor.
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:31 user nova-compute[72954]: INFO nova.compute.manager [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Took 7.23 seconds to build instance.
Sep 04 23:34:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80258966-60ab-4cab-ac4c-601ff343d590 tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.340s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] No waiting events found dispatching network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:31 user nova-compute[72954]: WARNING nova.compute.manager [req-acdf695d-750a-4c7d-9606-b79da22c4695 req-826cc5d3-ab3a-4b0f-bcde-a16634c4468b service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received unexpected event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e for instance with vm_state active and task_state None.
Sep 04 23:34:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:34:46 user nova-compute[72954]: INFO nova.compute.claims [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Claim successful on node user
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:34:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.policy [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b754b34e954e435a97130f83ef9d5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fc8d5e6302420a8056028f7c9bbdf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:34:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Creating image(s)
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "f91df794bee4589d59ba5f9673be00eee907c118" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "f91df794bee4589d59ba5f9673be00eee907c118" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.part --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG nova.virt.images [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] 2a793278-a4dd-4fbf-b68b-be74cb827870 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.part /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Successfully created port: b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.part /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.converted" returned: 0 in 0.245s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "f91df794bee4589d59ba5f9673be00eee907c118" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.291s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json" returned: 0 in 0.273s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "f91df794bee4589d59ba5f9673be00eee907c118" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "f91df794bee4589d59ba5f9673be00eee907c118" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json" returned: 0 in 0.244s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118,backing_fmt=raw /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118,backing_fmt=raw /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk 1073741824" returned: 0 in 0.068s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "f91df794bee4589d59ba5f9673be00eee907c118" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json" returned: 0 in 0.259s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Cannot resize image /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Ensure instance console log exists: /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Successfully updated port: b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing instance network info cache due to event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance network_info: |[{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start _get_guest_xml network_info=[{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:34:42Z,direct_url=<?>,disk_format='qcow2',id=2a793278-a4dd-4fbf-b68b-be74cb827870,min_disk=0,min_ram=0,name='tempest-scenario-img--118780833',owner='a4fc8d5e6302420a8056028f7c9bbdf6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:34:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '2a793278-a4dd-4fbf-b68b-be74cb827870'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:34:50 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:50 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:34:42Z,direct_url=<?>,disk_format='qcow2',id=2a793278-a4dd-4fbf-b68b-be74cb827870,min_disk=0,min_ram=0,name='tempest-scenario-img--118780833',owner='a4fc8d5e6302420a8056028f7c9bbdf6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:34:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:47Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'pci_devices' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:34:50 user nova-compute[72954]:   <uuid>a5e51f60-795c-4344-ac17-c7b5b9d9ad97</uuid>
Sep 04 23:34:50 user nova-compute[72954]:   <name>instance-00000012</name>
Sep 04 23:34:50 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:34:50 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:34:50 user nova-compute[72954]:   <metadata>
Sep 04 23:34:50 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:34:50 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:name>tempest-TestMinimumBasicScenario-server-1335181665</nova:name>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:34:50</nova:creationTime>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:34:50 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:34:50 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:owner>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:user uuid="b754b34e954e435a97130f83ef9d5622">tempest-TestMinimumBasicScenario-339041348-project-member</nova:user>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:project uuid="a4fc8d5e6302420a8056028f7c9bbdf6">tempest-TestMinimumBasicScenario-339041348</nova:project>
Sep 04 23:34:50 user nova-compute[72954]:       </nova:owner>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:root type="image" uuid="2a793278-a4dd-4fbf-b68b-be74cb827870"/>
Sep 04 23:34:50 user nova-compute[72954]:       <nova:ports>
Sep 04 23:34:50 user nova-compute[72954]:         <nova:port uuid="b6672997-a4c1-4cf8-acd9-5835c782a958">
Sep 04 23:34:50 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 04 23:34:50 user nova-compute[72954]:         </nova:port>
Sep 04 23:34:50 user nova-compute[72954]:       </nova:ports>
Sep 04 23:34:50 user nova-compute[72954]:     </nova:instance>
Sep 04 23:34:50 user nova-compute[72954]:   </metadata>
Sep 04 23:34:50 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:34:50 user nova-compute[72954]:     <system>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="serial">a5e51f60-795c-4344-ac17-c7b5b9d9ad97</entry>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="uuid">a5e51f60-795c-4344-ac17-c7b5b9d9ad97</entry>
Sep 04 23:34:50 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:34:50 user nova-compute[72954]:     </system>
Sep 04 23:34:50 user nova-compute[72954]:   </sysinfo>
Sep 04 23:34:50 user nova-compute[72954]:   <os>
Sep 04 23:34:50 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:34:50 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:34:50 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:34:50 user nova-compute[72954]:   </os>
Sep 04 23:34:50 user nova-compute[72954]:   <features>
Sep 04 23:34:50 user nova-compute[72954]:     <acpi/>
Sep 04 23:34:50 user nova-compute[72954]:     <apic/>
Sep 04 23:34:50 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:34:50 user nova-compute[72954]:   </features>
Sep 04 23:34:50 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:34:50 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:34:50 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:34:50 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:34:50 user nova-compute[72954]:   </clock>
Sep 04 23:34:50 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:34:50 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:34:50 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:34:50 user nova-compute[72954]:   </cpu>
Sep 04 23:34:50 user nova-compute[72954]:   <devices>
Sep 04 23:34:50 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:34:50 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:34:50 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk"/>
Sep 04 23:34:50 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:34:50 user nova-compute[72954]:     </disk>
Sep 04 23:34:50 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:34:50 user nova-compute[72954]:       <mac address="fa:16:3e:a4:75:3a"/>
Sep 04 23:34:50 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:50 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:34:50 user nova-compute[72954]:       <target dev="tapb6672997-a4"/>
Sep 04 23:34:50 user nova-compute[72954]:     </interface>
Sep 04 23:34:50 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:34:50 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/console.log" append="off"/>
Sep 04 23:34:50 user nova-compute[72954]:     </serial>
Sep 04 23:34:50 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:34:50 user nova-compute[72954]:     <video>
Sep 04 23:34:50 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:34:50 user nova-compute[72954]:     </video>
Sep 04 23:34:50 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:34:50 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:34:50 user nova-compute[72954]:     </rng>
Sep 04 23:34:50 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:34:50 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:34:50 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:34:50 user nova-compute[72954]:     </memballoon>
Sep 04 23:34:50 user nova-compute[72954]:   </devices>
Sep 04 23:34:50 user nova-compute[72954]: </domain>
Sep 04 23:34:50 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:47Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG os_vif [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:34:50 user nova-compute[72954]: INFO nova.compute.claims [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Claim successful on node user
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6672997-a4, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6672997-a4, col_values=(('external_ids', {'iface-id': 'b6672997-a4c1-4cf8-acd9-5835c782a958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:75:3a', 'vm-uuid': 'a5e51f60-795c-4344-ac17-c7b5b9d9ad97'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:50 user nova-compute[72954]: INFO os_vif [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4')
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No VIF found with MAC fa:16:3e:a4:75:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updated VIF entry in instance network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b242330-d738-46e6-bb94-8a273d6fbb97 req-69d149df-ba27-4e92-862f-d9ba4b14c321 service nova] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:34:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:34:51 user nova-compute[72954]: INFO nova.virt.block_device [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Booting with volume 2db09f32-5798-4b04-bda8-f9b151a9e3ad at /dev/vda
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.policy [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d9225a248e74846a14e23c39b73af40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f8d72425c1459c92ad272dcae828a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.utils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9740beb7-b577-4e86-a62c-1472ac81250e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3909736-79c8-4f1d-ba86-f954ada1198e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[850a13bd-1a04-4be0-b7d5-9f4584331c92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2703c6-f3b6-4b67-a1fe-82db6059d96b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:34:51 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:34:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa0d218-4011-4fbd-8608-e2e7a1d98b19]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG os_brick.utils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:34:51 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating existing volume attachment record: 511eda56-f126-49d6-949f-abfc5140eea2 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-changed-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Refreshing instance network info cache due to event network-changed-49a6e5e0-5816-4f60-84fd-5e97b0f86faf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] Acquiring lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] Acquired lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Refreshing network info cache for port 49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:52 user nova-compute[72954]: WARNING nova.compute.manager [req-e4032d18-13d1-4afe-a1fa-b5b451906259 req-656f34e3-729f-405d-aec1-614278d89c3e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state building and task_state spawning.
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Successfully created port: a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:52 user nova-compute[72954]: INFO nova.compute.manager [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Terminating instance
Sep 04 23:34:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'flavor' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:53 user nova-compute[72954]: INFO nova.compute.manager [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attaching volume 2821c146-33ea-4f06-a02a-9ae77990dd4a to /dev/vdb
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updated VIF entry in instance network info cache for port 49a6e5e0-5816-4f60-84fd-5e97b0f86faf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating instance_info_cache with network_info: [{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1dab9b5c-4ece-4cd3-aa0e-26185c8fd683 req-bef1fe30-6290-4d51-b63b-6c960bcbaa4e service nova] Releasing lock "refresh_cache-98b7e205-7840-4e98-9f69-2cf6e7142202" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.utils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf572a7-14b8-4d9e-996a-76255d5ff38f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d072a048-a213-41bb-987d-c773af4a7a8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b3cc0f-770c-4d21-b175-208dbbf432df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1714aed-cd5f-46d1-9565-a799147eecb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:34:53 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:34:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a6bda2-579b-4151-8810-cd2c7cba7368]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_brick.utils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating existing volume attachment record: 47cf084b-7964-4186-9a7d-38514e45fb18 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Instance destroyed successfully.
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'resources' on Instance uuid 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-892851063',display_name='tempest-VolumesAdminNegativeTest-server-892851063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-892851063',id=15,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:32:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-qtf4zh6y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:32:53Z,user_data=None,user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "6a629503-3a27-421c-b44e-cbac53022d75", "address": "fa:16:3e:64:5a:97", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a629503-3a", "ovs_interfaceid": "6a629503-3a27-421c-b44e-cbac53022d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG os_vif [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a629503-3a, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:34:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:53 user nova-compute[72954]: INFO os_vif [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:97,bridge_name='br-int',has_traffic_filtering=True,id=6a629503-3a27-421c-b44e-cbac53022d75,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a629503-3a')
Sep 04 23:34:53 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Deleting instance files /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57_del
Sep 04 23:34:53 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Deletion of /opt/stack/data/nova/instances/00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57_del complete
Sep 04 23:34:54 user nova-compute[72954]: INFO nova.compute.manager [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Took 1.05 seconds to destroy the instance on the hypervisor.
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Successfully updated port: a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquired lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-changed-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Refreshing instance network info cache due to event network-changed-a1df8d1c-86a8-4f87-a770-5365dd719443. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] Acquiring lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:54 user nova-compute[72954]: WARNING nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state building and task_state spawning.
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-unplugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] No waiting events found dispatching network-vif-unplugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-unplugged-6a629503-3a27-421c-b44e-cbac53022d75 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Acquiring lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] No waiting events found dispatching network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:34:54 user nova-compute[72954]: WARNING nova.compute.manager [req-7b9256d5-1b63-458f-add5-ec57458fc6aa req-8671b528-a7f3-4c78-8d6f-842209bdfd48 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received unexpected event network-vif-plugged-6a629503-3a27-421c-b44e-cbac53022d75 for instance with vm_state active and task_state deleting.
Sep 04 23:34:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Took 1.04 seconds to deallocate network for instance.
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating instance_info_cache with network_info: [{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870495.1653297, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] VM Resumed (Lifecycle Event)
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Releasing lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance network_info: |[{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] Acquired lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Refreshing network info cache for port a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance spawned successfully.
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870495.1674736, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] VM Started (Lifecycle Event)
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Took 8.44 seconds to spawn the instance on the hypervisor.
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.compute.manager [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Took 9.42 seconds to build instance.
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1a759b7f-85a3-447c-a301-edef23e6a065 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.526s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updated VIF entry in instance network info cache for port a1df8d1c-86a8-4f87-a770-5365dd719443. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating instance_info_cache with network_info: [{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a64b029c-dbd3-4898-a8de-a77e7dbefe8c req-abf5eee7-feb8-4015-b1d7-11d9f1c78c07 service nova] Releasing lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:55 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Deleted allocations for instance 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57
Sep 04 23:34:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3d8436c8-2b85-4234-bc13-fde1e62fb82f tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:34:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:34:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-80e84068-bc70-474c-8084-56bc9016f641 req-d4ca2258-ece1-418e-a96c-f5c52f984254 service nova] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Received event network-vif-deleted-6a629503-3a27-421c-b44e-cbac53022d75 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:34:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:35:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:35:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:04 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:35:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Creating image(s)
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Ensure instance console log exists: /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start _get_guest_xml network_info=[{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82e7603c-406f-407f-8893-453c44ebd868', 'attached_at': '', 'detached_at': '', 'volume_id': '2db09f32-5798-4b04-bda8-f9b151a9e3ad', 'serial': '2db09f32-5798-4b04-bda8-f9b151a9e3ad'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '511eda56-f126-49d6-949f-abfc5140eea2', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:35:08 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:08 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:08 user nova-compute[72954]: INFO nova.compute.manager [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Unrescuing
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:08 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:35:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4016588-ff58-44bf-977a-1d90b23a4ce9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:35:08 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b59456-717c-4f99-9717-f7504b6fcdb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad] added
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[899936ca-01c4-4cc8-8e8d-3a09c56c2a73]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a9848-f50a-4259-8ea3-9490daaeda2a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FchOQmvI {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FchOQmvI" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1144d72-22b3-4d97-866b-e4e612c771f5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FchOQmvI'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0697d8-5120-42b4-a9e5-f0ef200247d0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc56ebe-21ab-4c5b-8e83-31b89bc7b96e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a4a1b6-441b-409a-b147-5511b236d564]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]
Sep 04 23:35:08 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0070e1-3cd5-4a39-81df-984454e9a4c5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb03ae-b42d-4d86-9f19-d4784ed29c65]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:08 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a078f-edf7-4949-a2ed-b2bf10c9ec06]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870493.809661, 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:08 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] VM Stopped (Lifecycle Event)
Sep 04 23:35:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a5333cad-ceec-4efc-96c9-b65af9736461 None None] [instance: 00ebe1f4-bb5a-4d5c-8238-bcc96d02ab57] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'flavor' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26631626538663532', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631626538663532', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-443982407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.objects.instance [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lazy-loading 'pci_devices' on Instance uuid 82e7603c-406f-407f-8893-453c44ebd868 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:35:09 user nova-compute[72954]:   <uuid>82e7603c-406f-407f-8893-453c44ebd868</uuid>
Sep 04 23:35:09 user nova-compute[72954]:   <name>instance-00000013</name>
Sep 04 23:35:09 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:35:09 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:35:09 user nova-compute[72954]:   <metadata>
Sep 04 23:35:09 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:35:09 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:35:09 user nova-compute[72954]:       <nova:name>tempest-ServerActionsV293TestJSON-server-443982407</nova:name>
Sep 04 23:35:09 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:35:08</nova:creationTime>
Sep 04 23:35:09 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:35:09 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:35:09 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:35:09 user nova-compute[72954]:       <nova:owner>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:user uuid="9d9225a248e74846a14e23c39b73af40">tempest-ServerActionsV293TestJSON-1401063680-project-member</nova:user>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:project uuid="01f8d72425c1459c92ad272dcae828a5">tempest-ServerActionsV293TestJSON-1401063680</nova:project>
Sep 04 23:35:09 user nova-compute[72954]:       </nova:owner>
Sep 04 23:35:09 user nova-compute[72954]:       <nova:ports>
Sep 04 23:35:09 user nova-compute[72954]:         <nova:port uuid="a1df8d1c-86a8-4f87-a770-5365dd719443">
Sep 04 23:35:09 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Sep 04 23:35:09 user nova-compute[72954]:         </nova:port>
Sep 04 23:35:09 user nova-compute[72954]:       </nova:ports>
Sep 04 23:35:09 user nova-compute[72954]:     </nova:instance>
Sep 04 23:35:09 user nova-compute[72954]:   </metadata>
Sep 04 23:35:09 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:35:09 user nova-compute[72954]:     <system>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="serial">82e7603c-406f-407f-8893-453c44ebd868</entry>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="uuid">82e7603c-406f-407f-8893-453c44ebd868</entry>
Sep 04 23:35:09 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:35:09 user nova-compute[72954]:     </system>
Sep 04 23:35:09 user nova-compute[72954]:   </sysinfo>
Sep 04 23:35:09 user nova-compute[72954]:   <os>
Sep 04 23:35:09 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:35:09 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:35:09 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:35:09 user nova-compute[72954]:   </os>
Sep 04 23:35:09 user nova-compute[72954]:   <features>
Sep 04 23:35:09 user nova-compute[72954]:     <acpi/>
Sep 04 23:35:09 user nova-compute[72954]:     <apic/>
Sep 04 23:35:09 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:35:09 user nova-compute[72954]:   </features>
Sep 04 23:35:09 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:35:09 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:35:09 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:35:09 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:35:09 user nova-compute[72954]:   </clock>
Sep 04 23:35:09 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:35:09 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:35:09 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:35:09 user nova-compute[72954]:   </cpu>
Sep 04 23:35:09 user nova-compute[72954]:   <devices>
Sep 04 23:35:09 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:35:09 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:09 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:35:09 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:35:09 user nova-compute[72954]:       <serial>2db09f32-5798-4b04-bda8-f9b151a9e3ad</serial>
Sep 04 23:35:09 user nova-compute[72954]:     </disk>
Sep 04 23:35:09 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:35:09 user nova-compute[72954]:       <mac address="fa:16:3e:9e:30:71"/>
Sep 04 23:35:09 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:09 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:35:09 user nova-compute[72954]:       <target dev="tapa1df8d1c-86"/>
Sep 04 23:35:09 user nova-compute[72954]:     </interface>
Sep 04 23:35:09 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:35:09 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868/console.log" append="off"/>
Sep 04 23:35:09 user nova-compute[72954]:     </serial>
Sep 04 23:35:09 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:35:09 user nova-compute[72954]:     <video>
Sep 04 23:35:09 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:09 user nova-compute[72954]:     </video>
Sep 04 23:35:09 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:35:09 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:35:09 user nova-compute[72954]:     </rng>
Sep 04 23:35:09 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:35:09 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:35:09 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:35:09 user nova-compute[72954]:     </memballoon>
Sep 04 23:35:09 user nova-compute[72954]:   </devices>
Sep 04 23:35:09 user nova-compute[72954]: </domain>
Sep 04 23:35:09 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-443982407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG os_vif [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1df8d1c-86, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1df8d1c-86, col_values=(('external_ids', {'iface-id': 'a1df8d1c-86a8-4f87-a770-5365dd719443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:30:71', 'vm-uuid': '82e7603c-406f-407f-8893-453c44ebd868'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: INFO os_vif [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86')
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] No VIF found with MAC fa:16:3e:9e:30:71, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:10 user nova-compute[72954]: WARNING nova.compute.manager [req-4ce63ef4-d83c-447c-aaab-bcedb28fb0a9 req-ea29a85a-edbd-4d9b-a1e9-51562a3df696 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance destroyed successfully.
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:11 user nova-compute[72954]: INFO nova.compute.manager [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Terminating instance
Sep 04 23:35:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:11 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:11 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:11 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d29c4e-71c1-4c6e-bef2-bb8705f77f32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:35:11 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-unplugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] No waiting events found dispatching network-vif-unplugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-4967d93f-4e84-4823-8e94-d6a84cdd51f4 req-9ae61620-69ba-4c8e-aad8-6654e97848ba service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-unplugged-d249f205-6e80-4b22-9a2d-c9924bb04418 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[96026d2d-1ccd-42a8-b5ee-0c245c272bdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a] added
Sep 04 23:35:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878e8ad-7837-4844-b76d-04711191dea6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.103s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3263843d-2198-448c-a3f6-ad454b7f3d9a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCIdjGBi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCIdjGBi" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a7d41a-01bc-44c4-9722-28851b1dcfde]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCIdjGBi'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de71d7-701f-432c-90bd-df829f9967f9]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece954a-dbf0-450c-88bd-aa9b255806e5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:11 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:11 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:11 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:11 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870515.9642596, 82e7603c-406f-407f-8893-453c44ebd868 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Resumed (Lifecycle Event)
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a8781d-fbb2-4c21-a3f1-ee59a74a406f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5bbd031a-e8f2-40b6-a5c2-b9092fb218c0 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]
Sep 04 23:35:16 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.
Sep 04 23:35:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-changed-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing instance network info cache due to event network-changed-751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing network info cache for port 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.compute.manager [req-3ae5604b-5084-4dc4-9095-a91248c87988 req-d213c5b0-dc00-4d62-b502-79d350a4b94a service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state building and task_state spawning.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] Acquiring lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] No waiting events found dispatching network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.compute.manager [req-46dce255-67c1-4e32-95ff-aafe211db938 req-b1a52b06-edf8-41fb-8ff5-c2fdc54a889d service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received unexpected event network-vif-plugged-d249f205-6e80-4b22-9a2d-c9924bb04418 for instance with vm_state active and task_state deleting.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.compute.manager [req-0cb86570-9592-49d2-9766-f0b8fd141102 req-32d16ae6-debe-4af9-9b5a-7a5860532e47 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.compute.manager [req-09e20e26-df87-48b8-9ac9-d5a4c0fd2e8c req-86efdc79-2d01-4881-abdb-a029cf28c539 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state building and task_state spawning.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a67ea25-d86b-4485-935c-0b9a816a630c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Instance destroyed successfully.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lazy-loading 'resources' on Instance uuid 016c702e-e3f2-416d-8faa-164bb25eabdc {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd67b24-37fd-448a-a477-5d26ba93a6a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:16 user nova-compute[72954]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 4.996s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-09-04T23:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-461411492',display_name='tempest-AttachSCSIVolumeTestJSON-server-461411492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-461411492',id=8,image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDffEw5+0U+AbCbHG9LOO4aFONuM7LELbHMXskkcSWzyEZYsoVrsRs0l5XrBA2IYpVGR6O45xB89tlBXHwY1Zf8am+VV19MczRBL0/+GFXQxG5cySx9BsCS2SUamL+FDjg==',key_name='tempest-keypair-1758342468',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9fea4a71daa4dc09370352ed256652a',ramdisk_id='',reservation_id='r-qx038vx9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5b4a1f56-870d-4e5a-b979-324451e46016',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1082228639',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1082228639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e00d4f84f374ca481c2c48c0f108494',uuid=016c702e-e3f2-416d-8faa-164bb25eabdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converting VIF {"id": "d249f205-6e80-4b22-9a2d-c9924bb04418", "address": "fa:16:3e:9a:f4:6c", "network": {"id": "a56ee902-8931-4e7d-a067-0d1f541937ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-602704829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9fea4a71daa4dc09370352ed256652a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249f205-6e", "ovs_interfaceid": "d249f205-6e80-4b22-9a2d-c9924bb04418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_vif [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870515.9648087, 82e7603c-406f-407f-8893-453c44ebd868 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Started (Lifecycle Event)
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.136417388916016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd249f205-6e, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc6aa8-dc5f-4eff-b38f-dc52c15f3235]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance spawned successfully.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:35:16 user nova-compute[72954]: INFO os_vif [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:f4:6c,bridge_name='br-int',has_traffic_filtering=True,id=d249f205-6e80-4b22-9a2d-c9924bb04418,network=Network(a56ee902-8931-4e7d-a067-0d1f541937ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249f205-6e')
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Deleting instance files /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc_del
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Deletion of /opt/stack/data/nova/instances/016c702e-e3f2-416d-8faa-164bb25eabdc_del complete
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for de97c8d3-65e0-4770-bf2b-44d58b5e403e due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870515.9818532, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Resumed (Lifecycle Event)
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870515.9820557, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Started (Lifecycle Event)
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:17 user nova-compute[72954]: INFO nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Took 8.99 seconds to spawn the instance on the hypervisor.
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:17 user nova-compute[72954]: INFO nova.compute.manager [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Took 5.87 seconds to destroy the instance on the hypervisor.
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:35:17 user nova-compute[72954]: INFO nova.compute.manager [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Took 26.81 seconds to build instance.
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-586299e3-06fd-4048-8916-43a3c871b823 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.963s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 625f0d50-b25e-4542-863a-a65a8be8148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 016c702e-e3f2-416d-8faa-164bb25eabdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 56c16673-4ee4-41fe-a0a5-e92145477f66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 6.047s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== connect_volume: return (6049ms) {'type': 'block', 'scsi_wwn': '26234646363366234', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234646363366234', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'flavor' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:35:17 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:17 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:35:17 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:35:17 user nova-compute[72954]:   <serial>2821c146-33ea-4f06-a02a-9ae77990dd4a</serial>
Sep 04 23:35:17 user nova-compute[72954]: </disk>
Sep 04 23:35:17 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updated VIF entry in instance network info cache for port 751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-changed-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing instance network info cache due to event network-changed-751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Acquiring lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Acquired lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Refreshing network info cache for port 751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.337s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:17:e9:5d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ee2b8f6f-46da-4231-a286-7cece25b55f6 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.149s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updated VIF entry in instance network info cache for port 751176c8-9875-4a16-9f95-f0391238238b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [{"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Releasing lock "refresh_cache-de97c8d3-65e0-4770-bf2b-44d58b5e403e" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:19 user nova-compute[72954]: WARNING nova.compute.manager [req-3c6c82c6-2387-4f2b-9ae9-62834907753b req-2509dd00-b990-40e9-b969-79e317bcdcb3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:19 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Took 2.76 seconds to deallocate network for instance.
Sep 04 23:35:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-7098d63d-baf0-47e9-9172-b18f6bfb9b5f req-67f2ea69-cb42-4ba4-b5de-6843674fde70 service nova] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Received event network-vif-deleted-d249f205-6e80-4b22-9a2d-c9924bb04418 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:20 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Deleted allocations for instance 016c702e-e3f2-416d-8faa-164bb25eabdc
Sep 04 23:35:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a181e049-f2fb-45b8-96b4-523f8527bd0e tempest-AttachSCSIVolumeTestJSON-1082228639 tempest-AttachSCSIVolumeTestJSON-1082228639-project-member] Lock "016c702e-e3f2-416d-8faa-164bb25eabdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.492s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:20 user nova-compute[72954]: INFO nova.compute.manager [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Rebuilding instance
Sep 04 23:35:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:21 user nova-compute[72954]: WARNING nova.compute.manager [req-edd2148d-27be-402b-8d19-d1ee25f3905b req-043ce39d-44e4-4b00-8134-381ee90a7334 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state active and task_state rebuilding.
Sep 04 23:35:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance destroyed successfully.
Sep 04 23:35:22 user nova-compute[72954]: INFO nova.compute.manager [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Detaching volume 2821c146-33ea-4f06-a02a-9ae77990dd4a
Sep 04 23:35:22 user nova-compute[72954]: INFO nova.virt.block_device [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attempting to driver detach volume 2821c146-33ea-4f06-a02a-9ae77990dd4a from mountpoint /dev/vdb
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Attempting to detach device vdb from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:35:22 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:22 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:35:22 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:35:22 user nova-compute[72954]:   <serial>2821c146-33ea-4f06-a02a-9ae77990dd4a</serial>
Sep 04 23:35:22 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:35:22 user nova-compute[72954]: </disk>
Sep 04 23:35:22 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:35:22 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully detached device vdb from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the persistent domain config.
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:22 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5ee08-2737-4bc5-9c6b-9ee65af49a9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e390bbf-3778-45c0-b469-f3350cd0077a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:22 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:22 user nova-compute[72954]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:22 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130140e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ab282-f51a-4db4-ae77-1c8a0ad1fcb1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating instance_info_cache with network_info: [{"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-625f0d50-b25e-4542-863a-a65a8be8148d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f65b4-d512-4148-8c69-8e46d6646602]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77902ee2-fa96-443b-9436-b2187755af46]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f2a554-e786-4b24-b4ff-a131bffaca11]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.071s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98f887-ccd2-4ab7-ab69-eba03d51563c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a37a6-b3a8-49ae-be0a-dfdefdb64444]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]
Sep 04 23:35:22 user nova-compute[72954]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.
Sep 04 23:35:22 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993a2b1-549f-4069-bc07-bd40762d716b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== disconnect_volume: return (399ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:35:23 user nova-compute[72954]: INFO nova.compute.claims [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Claim successful on node user
Sep 04 23:35:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:23 user nova-compute[72954]: WARNING nova.compute.manager [req-c5536079-8c5f-48d3-b0b0-49235830ed2b req-9ac1af40-c308-4c6b-b0b0-40b9c1b5132b service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state active and task_state rebuilding.
Sep 04 23:35:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.875s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:35:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.policy [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ecac73ee2f44251a327642041bbd1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3ce2c11044ffd860d87380f4cca0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:35:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Creating image(s)
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Successfully created port: 254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance destroyed successfully.
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-ServerActionsTestOtherA-server-417883954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk 1073741824" returned: 0 in 0.064s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a6e5e0-58, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:25 user nova-compute[72954]: INFO os_vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58')
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:25 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2571e66-ffd2-4246-b893-9f602c940ddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac33e7ef-9a97-4c28-bfe7-681468746f32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:25 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:25 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:25 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183f1cf0>, {}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Disconnecting from: [] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== disconnect_volume: return (52ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:35:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Deleting instance files /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202_del
Sep 04 23:35:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Deletion of /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202_del complete
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: INFO nova.virt.block_device [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Booting with volume 2821c146-33ea-4f06-a02a-9ae77990dd4a at /dev/vdb
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.utils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Cannot resize image /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Ensure instance console log exists: /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c288b279-cd8d-4b4b-9d26-21fac33d9d3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[51658bed-be6e-4467-b659-e855609c9bdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ddcbb-5eaa-4621-86c0-efc39aac24ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db0e52-ad68-4d30-96f1-665976fdff14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:35:25 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d073b5-35f7-4bcb-85d6-cdb289349803]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG os_brick.utils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating existing volume attachment record: 9b0f5692-4b44-41d5-9e0e-fac1871f4a5f {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Successfully updated port: 254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-changed-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Refreshing instance network info cache due to event network-changed-254899bf-9c89-46ea-8390-fed26be7c8cb. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:35:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance network_info: |[{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Refreshing network info cache for port 254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start _get_guest_xml network_info=[{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:35:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'pci_devices' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:35:26 user nova-compute[72954]:   <uuid>663bbb50-2a1f-426a-92ba-6e925db7824f</uuid>
Sep 04 23:35:26 user nova-compute[72954]:   <name>instance-00000014</name>
Sep 04 23:35:26 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:35:26 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:35:26 user nova-compute[72954]:   <metadata>
Sep 04 23:35:26 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:35:26 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752440406</nova:name>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:35:26</nova:creationTime>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:35:26 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:35:26 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:owner>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:user uuid="1ecac73ee2f44251a327642041bbd1b3">tempest-ServerActionsTestOtherB-1198156614-project-member</nova:user>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:project uuid="39f3ce2c11044ffd860d87380f4cca0b">tempest-ServerActionsTestOtherB-1198156614</nova:project>
Sep 04 23:35:26 user nova-compute[72954]:       </nova:owner>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:35:26 user nova-compute[72954]:       <nova:ports>
Sep 04 23:35:26 user nova-compute[72954]:         <nova:port uuid="254899bf-9c89-46ea-8390-fed26be7c8cb">
Sep 04 23:35:26 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 04 23:35:26 user nova-compute[72954]:         </nova:port>
Sep 04 23:35:26 user nova-compute[72954]:       </nova:ports>
Sep 04 23:35:26 user nova-compute[72954]:     </nova:instance>
Sep 04 23:35:26 user nova-compute[72954]:   </metadata>
Sep 04 23:35:26 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:35:26 user nova-compute[72954]:     <system>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="serial">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="uuid">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:35:26 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:35:26 user nova-compute[72954]:     </system>
Sep 04 23:35:26 user nova-compute[72954]:   </sysinfo>
Sep 04 23:35:26 user nova-compute[72954]:   <os>
Sep 04 23:35:26 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:35:26 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:35:26 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:35:26 user nova-compute[72954]:   </os>
Sep 04 23:35:26 user nova-compute[72954]:   <features>
Sep 04 23:35:26 user nova-compute[72954]:     <acpi/>
Sep 04 23:35:26 user nova-compute[72954]:     <apic/>
Sep 04 23:35:26 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:35:26 user nova-compute[72954]:   </features>
Sep 04 23:35:26 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:35:26 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:35:26 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:35:26 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:35:26 user nova-compute[72954]:   </clock>
Sep 04 23:35:26 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:35:26 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:35:26 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:35:26 user nova-compute[72954]:   </cpu>
Sep 04 23:35:26 user nova-compute[72954]:   <devices>
Sep 04 23:35:26 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:35:26 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:35:26 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk"/>
Sep 04 23:35:26 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:35:26 user nova-compute[72954]:     </disk>
Sep 04 23:35:26 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:35:26 user nova-compute[72954]:       <mac address="fa:16:3e:c9:89:d0"/>
Sep 04 23:35:26 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:26 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:35:26 user nova-compute[72954]:       <target dev="tap254899bf-9c"/>
Sep 04 23:35:26 user nova-compute[72954]:     </interface>
Sep 04 23:35:26 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:35:26 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/console.log" append="off"/>
Sep 04 23:35:26 user nova-compute[72954]:     </serial>
Sep 04 23:35:26 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:35:26 user nova-compute[72954]:     <video>
Sep 04 23:35:26 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:26 user nova-compute[72954]:     </video>
Sep 04 23:35:26 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:35:26 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:35:26 user nova-compute[72954]:     </rng>
Sep 04 23:35:26 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:35:26 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:35:26 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:35:26 user nova-compute[72954]:     </memballoon>
Sep 04 23:35:26 user nova-compute[72954]:   </devices>
Sep 04 23:35:26 user nova-compute[72954]: </domain>
Sep 04 23:35:26 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG os_vif [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254899bf-9c, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254899bf-9c, col_values=(('external_ids', {'iface-id': '254899bf-9c89-46ea-8390-fed26be7c8cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:89:d0', 'vm-uuid': '663bbb50-2a1f-426a-92ba-6e925db7824f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:26 user nova-compute[72954]: INFO os_vif [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No VIF found with MAC fa:16:3e:c9:89:d0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updated VIF entry in instance network info cache for port 254899bf-9c89-46ea-8390-fed26be7c8cb. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f6501827-2bab-4d98-942b-bda9b1bf5211 req-641094e7-9381-4dff-ba70-6513482ed360 service nova] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:35:27 user nova-compute[72954]: INFO nova.compute.claims [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Claim successful on node user
Sep 04 23:35:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:35:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.policy [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2c3ec932cc64d98a8b1b6c10dd6f432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9857524a888d4d9f9d3e48341500411a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:35:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Creating image(s)
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk 1073741824" returned: 0 in 0.057s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Successfully created port: 28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Cannot resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Ensure instance console log exists: /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870529.7533631, 663bbb50-2a1f-426a-92ba-6e925db7824f => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Resumed (Lifecycle Event)
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:29 user nova-compute[72954]: WARNING nova.compute.manager [req-133fab72-ef91-48b0-8205-006c78838ac0 req-09c67c27-8e2d-4f98-bc9e-08faf70f6078 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state building and task_state spawning.
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance spawned successfully.
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870529.755741, 663bbb50-2a1f-426a-92ba-6e925db7824f => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Started (Lifecycle Event)
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:29 user nova-compute[72954]: INFO nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Took 5.43 seconds to spawn the instance on the hypervisor.
Sep 04 23:35:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:30 user nova-compute[72954]: INFO nova.compute.manager [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Took 6.73 seconds to build instance.
Sep 04 23:35:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65d27d70-1099-47b5-b835-cd937ec0ebf3 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.928s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Successfully updated port: 28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-changed-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Refreshing instance network info cache due to event network-changed-28ca716a-b39a-4923-8261-36a8a99899cf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:35:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance network_info: |[{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.neutron [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Refreshing network info cache for port 28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start _get_guest_xml network_info=[{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:35:31 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:31 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'pci_devices' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870512.3669875, 016c702e-e3f2-416d-8faa-164bb25eabdc => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:31 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] VM Stopped (Lifecycle Event)
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:35:31 user nova-compute[72954]:   <uuid>44a2a895-06fc-43e9-baab-0d30a22bce90</uuid>
Sep 04 23:35:31 user nova-compute[72954]:   <name>instance-00000015</name>
Sep 04 23:35:31 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:35:31 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:35:31 user nova-compute[72954]:   <metadata>
Sep 04 23:35:31 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:35:31 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeTestJSON-server-2106306957</nova:name>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:35:31</nova:creationTime>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:35:31 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:35:31 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:owner>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:user uuid="d2c3ec932cc64d98a8b1b6c10dd6f432">tempest-AttachVolumeTestJSON-79448822-project-member</nova:user>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:project uuid="9857524a888d4d9f9d3e48341500411a">tempest-AttachVolumeTestJSON-79448822</nova:project>
Sep 04 23:35:31 user nova-compute[72954]:       </nova:owner>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:35:31 user nova-compute[72954]:       <nova:ports>
Sep 04 23:35:31 user nova-compute[72954]:         <nova:port uuid="28ca716a-b39a-4923-8261-36a8a99899cf">
Sep 04 23:35:31 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Sep 04 23:35:31 user nova-compute[72954]:         </nova:port>
Sep 04 23:35:31 user nova-compute[72954]:       </nova:ports>
Sep 04 23:35:31 user nova-compute[72954]:     </nova:instance>
Sep 04 23:35:31 user nova-compute[72954]:   </metadata>
Sep 04 23:35:31 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:35:31 user nova-compute[72954]:     <system>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="serial">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="uuid">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:35:31 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:35:31 user nova-compute[72954]:     </system>
Sep 04 23:35:31 user nova-compute[72954]:   </sysinfo>
Sep 04 23:35:31 user nova-compute[72954]:   <os>
Sep 04 23:35:31 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:35:31 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:35:31 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:35:31 user nova-compute[72954]:   </os>
Sep 04 23:35:31 user nova-compute[72954]:   <features>
Sep 04 23:35:31 user nova-compute[72954]:     <acpi/>
Sep 04 23:35:31 user nova-compute[72954]:     <apic/>
Sep 04 23:35:31 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:35:31 user nova-compute[72954]:   </features>
Sep 04 23:35:31 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:35:31 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:35:31 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:35:31 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:35:31 user nova-compute[72954]:   </clock>
Sep 04 23:35:31 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:35:31 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:35:31 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:35:31 user nova-compute[72954]:   </cpu>
Sep 04 23:35:31 user nova-compute[72954]:   <devices>
Sep 04 23:35:31 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:35:31 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:35:31 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk"/>
Sep 04 23:35:31 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:35:31 user nova-compute[72954]:     </disk>
Sep 04 23:35:31 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:35:31 user nova-compute[72954]:       <mac address="fa:16:3e:d0:ea:8a"/>
Sep 04 23:35:31 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:31 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:35:31 user nova-compute[72954]:       <target dev="tap28ca716a-b3"/>
Sep 04 23:35:31 user nova-compute[72954]:     </interface>
Sep 04 23:35:31 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:35:31 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/console.log" append="off"/>
Sep 04 23:35:31 user nova-compute[72954]:     </serial>
Sep 04 23:35:31 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:35:31 user nova-compute[72954]:     <video>
Sep 04 23:35:31 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:31 user nova-compute[72954]:     </video>
Sep 04 23:35:31 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:35:31 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:35:31 user nova-compute[72954]:     </rng>
Sep 04 23:35:31 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:35:31 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:35:31 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:35:31 user nova-compute[72954]:     </memballoon>
Sep 04 23:35:31 user nova-compute[72954]:   </devices>
Sep 04 23:35:31 user nova-compute[72954]: </domain>
Sep 04 23:35:31 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG os_vif [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-76f2f948-9107-4500-b88a-d104925155aa None None] [instance: 016c702e-e3f2-416d-8faa-164bb25eabdc] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ca716a-b3, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28ca716a-b3, col_values=(('external_ids', {'iface-id': '28ca716a-b39a-4923-8261-36a8a99899cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ea:8a', 'vm-uuid': '44a2a895-06fc-43e9-baab-0d30a22bce90'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:31 user nova-compute[72954]: INFO os_vif [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No VIF found with MAC fa:16:3e:d0:ea:8a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:31 user nova-compute[72954]: WARNING nova.compute.manager [req-140c8ece-675b-41a9-9fa8-80468d01c652 req-3b06a4bc-9800-4a80-9cc8-d311239ad083 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state None.
Sep 04 23:35:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updated VIF entry in instance network info cache for port 28ca716a-b39a-4923-8261-36a8a99899cf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:35:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f049fb07-98c1-47a6-867a-b4be185ec8dc req-09c45685-9d58-4813-875d-f7a4c0fe9a3a service nova] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:33 user nova-compute[72954]: WARNING nova.compute.manager [req-f063e7ac-4eb0-48d2-8581-d1d90b8b037f req-b38cb3ab-d47f-45b1-90c8-7894e56f9474 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state building and task_state spawning.
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:35 user nova-compute[72954]: WARNING nova.compute.manager [req-00e7a62d-409a-4c4e-824c-f4de965a4b17 req-e1b55888-83ee-4cee-9bdf-ee13ded4db40 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state building and task_state spawning.
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870535.5436316, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Resumed (Lifecycle Event)
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance spawned successfully.
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870535.5546744, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Started (Lifecycle Event)
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:35:35 user nova-compute[72954]: INFO nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Took 7.36 seconds to spawn the instance on the hypervisor.
Sep 04 23:35:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:36 user nova-compute[72954]: INFO nova.compute.manager [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Took 8.49 seconds to build instance.
Sep 04 23:35:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7116ccca-5605-4375-83c7-ebab434ccccb tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.638s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:36 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870521.9040616, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:36 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Stopped (Lifecycle Event)
Sep 04 23:35:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-041e7664-3e8b-41f5-819e-80307f851578 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:43 user nova-compute[72954]: INFO nova.compute.manager [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Detaching volume cfa2fb37-1283-4806-b2e7-e9abc46618aa
Sep 04 23:35:43 user nova-compute[72954]: INFO nova.virt.block_device [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Attempting to driver detach volume cfa2fb37-1283-4806-b2e7-e9abc46618aa from mountpoint /dev/vdb
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Attempting to detach device vdb from instance de97c8d3-65e0-4770-bf2b-44d58b5e403e from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:35:43 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:43 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:35:43 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:35:43 user nova-compute[72954]:   <serial>cfa2fb37-1283-4806-b2e7-e9abc46618aa</serial>
Sep 04 23:35:43 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:35:43 user nova-compute[72954]: </disk>
Sep 04 23:35:43 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:35:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Successfully detached device vdb from instance de97c8d3-65e0-4770-bf2b-44d58b5e403e from the persistent domain config.
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de97c8d3-65e0-4770-bf2b-44d58b5e403e from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:35:43 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:43 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:35:43 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:35:43 user nova-compute[72954]:   <serial>cfa2fb37-1283-4806-b2e7-e9abc46618aa</serial>
Sep 04 23:35:43 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:35:43 user nova-compute[72954]: </disk>
Sep 04 23:35:43 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:35:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Creating image(s)
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870543.6486807, de97c8d3-65e0-4770-bf2b-44d58b5e403e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:35:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Successfully detached device vdb from instance de97c8d3-65e0-4770-bf2b-44d58b5e403e from the live domain config.
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpFEGRJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:43 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk 1073741824" returned: 0 in 0.062s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1185dad1-4202-4018-8e28-51a79db696c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f971b9-7f4b-4197-8980-57631e0008b5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:43 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:43 user nova-compute[72954]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa (non-flash)
Sep 04 23:35:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13031a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae4375-b8f1-4e28-a5c6-698cd7fec478]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5bb3e0-dcbd-45bf-ad85-8e55da4a4eea]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc80c2-fd74-4119-9562-ebee481d606b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:35:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.264s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3f498-d365-4ae5-844d-cc32b09c513b]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Cannot resize image /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Ensure instance console log exists: /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start _get_guest_xml network_info=[{"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98b7e205-7840-4e98-9f69-2cf6e7142202', 'attached_at': '', 'detached_at': '', 'volume_id': '2821c146-33ea-4f06-a02a-9ae77990dd4a', 'serial': '2821c146-33ea-4f06-a02a-9ae77990dd4a'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '9b0f5692-4b44-41d5-9e0e-fac1871f4a5f', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db4c02-41c8-4152-9b9a-6fb63f7f82d5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Sep 04 23:35:44 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:35:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a315b9-e5e4-4feb-bc5e-c05a90962225]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260]
Sep 04 23:35:44 user nova-compute[72954]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa, portal: 172.16.0.220,3260] successful.
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa2fb37-1283-4806-b2e7-e9abc46618aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ef08c-1dbb-4add-9b23-35c3b1d6a849]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.609s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] <== disconnect_volume: return (611ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.061s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:35:44 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de760e47-03c1-456d-b2f3-adf72792509f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:35:44 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9101299-b366-4eef-8d93-a6011528aa2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a] added
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21746ac3-4b81-42de-9dc6-adc90e36030c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b795a-19e2-4135-9c11-89e93b9ea31d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCIdjGBi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCIdjGBi" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0531ea-9c44-4677-9abd-78deb7f94401]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCIdjGBi'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7ca17-ba69-41ed-b290-33c9713ccd92]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[239269e3-60cf-432e-9dd4-ca695f7d7c57]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aca3bb-09a6-4409-bc81-60820946119f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]
Sep 04 23:35:44 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1894e53-5975-439c-b3fa-efa334ce20a1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a023e5-7563-4191-96d4-1dfc86530872]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:35:44 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:35:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0590e6-feb4-4ed1-a317-3f7f0481b4ae]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:35:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:35:45 user nova-compute[72954]: INFO nova.compute.manager [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Unrescuing
Sep 04 23:35:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.network.neutron [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26234646363366234', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234646363366234', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-ServerActionsTestOtherA-server-417883954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:35:45 user nova-compute[72954]:   <uuid>98b7e205-7840-4e98-9f69-2cf6e7142202</uuid>
Sep 04 23:35:45 user nova-compute[72954]:   <name>instance-00000010</name>
Sep 04 23:35:45 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:35:45 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:35:45 user nova-compute[72954]:   <metadata>
Sep 04 23:35:45 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:35:45 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherA-server-417883954</nova:name>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:35:44</nova:creationTime>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:35:45 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:35:45 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:owner>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:user uuid="3694a9f4359a487db80ec71c526201be">tempest-ServerActionsTestOtherA-520106611-project-member</nova:user>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:project uuid="9c2f8d4f90e74533b0f0b96581c8bd5a">tempest-ServerActionsTestOtherA-520106611</nova:project>
Sep 04 23:35:45 user nova-compute[72954]:       </nova:owner>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:35:45 user nova-compute[72954]:       <nova:ports>
Sep 04 23:35:45 user nova-compute[72954]:         <nova:port uuid="49a6e5e0-5816-4f60-84fd-5e97b0f86faf">
Sep 04 23:35:45 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 04 23:35:45 user nova-compute[72954]:         </nova:port>
Sep 04 23:35:45 user nova-compute[72954]:       </nova:ports>
Sep 04 23:35:45 user nova-compute[72954]:     </nova:instance>
Sep 04 23:35:45 user nova-compute[72954]:   </metadata>
Sep 04 23:35:45 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:35:45 user nova-compute[72954]:     <system>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="serial">98b7e205-7840-4e98-9f69-2cf6e7142202</entry>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="uuid">98b7e205-7840-4e98-9f69-2cf6e7142202</entry>
Sep 04 23:35:45 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:35:45 user nova-compute[72954]:     </system>
Sep 04 23:35:45 user nova-compute[72954]:   </sysinfo>
Sep 04 23:35:45 user nova-compute[72954]:   <os>
Sep 04 23:35:45 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:35:45 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:35:45 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:35:45 user nova-compute[72954]:   </os>
Sep 04 23:35:45 user nova-compute[72954]:   <features>
Sep 04 23:35:45 user nova-compute[72954]:     <acpi/>
Sep 04 23:35:45 user nova-compute[72954]:     <apic/>
Sep 04 23:35:45 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:35:45 user nova-compute[72954]:   </features>
Sep 04 23:35:45 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:35:45 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:35:45 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:35:45 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:35:45 user nova-compute[72954]:   </clock>
Sep 04 23:35:45 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:35:45 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:35:45 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:35:45 user nova-compute[72954]:   </cpu>
Sep 04 23:35:45 user nova-compute[72954]:   <devices>
Sep 04 23:35:45 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:35:45 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:35:45 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk"/>
Sep 04 23:35:45 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:35:45 user nova-compute[72954]:     </disk>
Sep 04 23:35:45 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:35:45 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:35:45 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 04 23:35:45 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:35:45 user nova-compute[72954]:       <serial>2821c146-33ea-4f06-a02a-9ae77990dd4a</serial>
Sep 04 23:35:45 user nova-compute[72954]:     </disk>
Sep 04 23:35:45 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:35:45 user nova-compute[72954]:       <mac address="fa:16:3e:17:e9:5d"/>
Sep 04 23:35:45 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:45 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:35:45 user nova-compute[72954]:       <target dev="tap49a6e5e0-58"/>
Sep 04 23:35:45 user nova-compute[72954]:     </interface>
Sep 04 23:35:45 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:35:45 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/console.log" append="off"/>
Sep 04 23:35:45 user nova-compute[72954]:     </serial>
Sep 04 23:35:45 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:35:45 user nova-compute[72954]:     <video>
Sep 04 23:35:45 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:35:45 user nova-compute[72954]:     </video>
Sep 04 23:35:45 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:35:45 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:35:45 user nova-compute[72954]:     </rng>
Sep 04 23:35:45 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:35:45 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:35:45 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:35:45 user nova-compute[72954]:     </memballoon>
Sep 04 23:35:45 user nova-compute[72954]:   </devices>
Sep 04 23:35:45 user nova-compute[72954]: </domain>
Sep 04 23:35:45 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-ServerActionsTestOtherA-server-417883954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG os_vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a6e5e0-58, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49a6e5e0-58, col_values=(('external_ids', {'iface-id': '49a6e5e0-5816-4f60-84fd-5e97b0f86faf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:e9:5d', 'vm-uuid': '98b7e205-7840-4e98-9f69-2cf6e7142202'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:45 user nova-compute[72954]: INFO os_vif [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58')
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:35:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:17:e9:5d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'flavor' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:46 user nova-compute[72954]: WARNING nova.compute.manager [req-19e8941d-9dbb-4dfb-b515-d4362187e6bf req-12508b31-8eb7-4efd-ab8d-0d94cc601f68 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:35:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance destroyed successfully.
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:47 user nova-compute[72954]: WARNING nova.compute.manager [req-cf725754-33f6-402f-b19c-8e4a1b186d2d req-06cc6741-9d9b-43eb-b8c2-b1cd9b8b971e service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state active and task_state rebuild_spawning.
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:48 user nova-compute[72954]: WARNING nova.compute.manager [req-7bc5d8a8-6bbe-4355-a7e5-abfc6aa6021d req-5dbd63d5-bc58-4348-bc5f-49bc9349c84c service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:49 user nova-compute[72954]: WARNING nova.compute.manager [req-fa496cea-ce88-45bb-b649-f095adb68585 req-a5dd5c88-7c7e-4167-9fbe-ee2aeb175ee1 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state active and task_state rebuild_spawning.
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid b74564bb-948a-43be-81b7-8504f4dc023a {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid d57a3389-b5ab-4dc3-8729-6e87085a4e54 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 56c16673-4ee4-41fe-a0a5-e92145477f66 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 82e7603c-406f-407f-8893-453c44ebd868 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: INFO nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: INFO nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "82e7603c-406f-407f-8893-453c44ebd868" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "82e7603c-406f-407f-8893-453c44ebd868" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.178s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:50 user nova-compute[72954]: WARNING nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:50 user nova-compute[72954]: WARNING nova.compute.manager [req-17ab4159-1ed3-4013-99f3-483d2d201544 req-d30e9d92-1f33-444e-85ff-023f1f19b542 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870551.3985784, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Resumed (Lifecycle Event)
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance spawned successfully.
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870551.402536, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Started (Lifecycle Event)
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Sep 04 23:35:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72954) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0ca49716-0507-47e6-96d9-f8e353b9ffa2 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for 09afe965-5ce9-43b6-83f7-f0e378ef33e9 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870551.9865222, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Resumed (Lifecycle Event)
Sep 04 23:35:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-47f2caad-0d97-4100-b8ee-269872fdfeeb tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Sep 04 23:35:52 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870551.9879637, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Started (Lifecycle Event)
Sep 04 23:35:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'flavor' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ca98eba7-36e0-4f7e-8a0b-732b04a8182f tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.492s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.617s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:53 user nova-compute[72954]: INFO nova.compute.manager [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Terminating instance
Sep 04 23:35:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:53 user nova-compute[72954]: INFO nova.compute.manager [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Unrescuing
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-unplugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] No waiting events found dispatching network-vif-unplugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-a5a9849f-deee-4159-8dd4-eab45a1b0fd1 req-ac88c951-f9ae-4052-9f8f-bfc3c77022d3 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-unplugged-e25d703b-4dcd-4550-87c9-c254515dcacf for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Instance destroyed successfully.
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lazy-loading 'resources' on Instance uuid 625f0d50-b25e-4542-863a-a65a8be8148d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1416911431',display_name='tempest-VolumesAdminNegativeTest-server-1416911431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1416911431',id=6,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9ecI2QEaJZVk8IBkRJVO3rGpQD8Nd4kYyFwGkzm/YDckojLLNaiAEtoVFoNyZBglJujL2nSRGHlrkZRz5P8TDD5Af0G5wtIM+qI85BVqKtXNksSGI/BYjfV170dKYQTg==',key_name='tempest-keypair-1488180374',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa30aac7532d4178be510b5f39c3211c',ramdisk_id='',reservation_id='r-law4a72m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-647256197',owner_user_name='tempest-VolumesAdminNegativeTest-647256197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b7def3475ff4df1a6ce5664ecbe33cd',uuid=625f0d50-b25e-4542-863a-a65a8be8148d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converting VIF {"id": "e25d703b-4dcd-4550-87c9-c254515dcacf", "address": "fa:16:3e:4e:93:05", "network": {"id": "64c6b49c-d467-41bb-b6a6-b915fa822962", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1591052768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa30aac7532d4178be510b5f39c3211c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape25d703b-4d", "ovs_interfaceid": "e25d703b-4dcd-4550-87c9-c254515dcacf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG os_vif [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape25d703b-4d, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:35:54 user nova-compute[72954]: INFO os_vif [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:93:05,bridge_name='br-int',has_traffic_filtering=True,id=e25d703b-4dcd-4550-87c9-c254515dcacf,network=Network(64c6b49c-d467-41bb-b6a6-b915fa822962),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape25d703b-4d')
Sep 04 23:35:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Deleting instance files /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d_del
Sep 04 23:35:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Deletion of /opt/stack/data/nova/instances/625f0d50-b25e-4542-863a-a65a8be8148d_del complete
Sep 04 23:35:54 user nova-compute[72954]: INFO nova.compute.manager [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Took 0.99 seconds to destroy the instance on the hypervisor.
Sep 04 23:35:54 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'flavor' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance destroyed successfully.
Sep 04 23:35:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Acquiring lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Lock "625f0d50-b25e-4542-863a-a65a8be8148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] No waiting events found dispatching network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:56 user nova-compute[72954]: WARNING nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received unexpected event network-vif-plugged-e25d703b-4dcd-4550-87c9-c254515dcacf for instance with vm_state active and task_state deleting.
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:56 user nova-compute[72954]: WARNING nova.compute.manager [req-a889f9c3-a126-4ed0-93cb-d7a2d4698455 req-da6ddaf6-2f47-4c04-b4c9-59b3b4b344fa service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:35:56 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Took 2.07 seconds to deallocate network for instance.
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:57 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:35:57 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:35:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.815s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:57 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Deleted allocations for instance 625f0d50-b25e-4542-863a-a65a8be8148d
Sep 04 23:35:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-98ff742a-22c5-412c-8243-daf46d96af57 tempest-VolumesAdminNegativeTest-647256197 tempest-VolumesAdminNegativeTest-647256197-project-member] Lock "625f0d50-b25e-4542-863a-a65a8be8148d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.071s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:58 user nova-compute[72954]: WARNING nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Received event network-vif-deleted-e25d703b-4dcd-4550-87c9-c254515dcacf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:58 user nova-compute[72954]: WARNING nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:35:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:35:58 user nova-compute[72954]: WARNING nova.compute.manager [req-61a87886-5dbf-4fb1-ab57-addec36b2561 req-2f3de11e-b245-4bfc-80fc-497868055945 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:35:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for 2e25e677-e6be-43ef-9663-6c6fdeddf302 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870559.4677708, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Resumed (Lifecycle Event)
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-cb9cef40-3c4f-4b1a-9271-dd3a1dd4d553 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:35:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] During sync_power_state the instance has a pending task (unrescuing). Skip.
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870559.4692352, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:35:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Started (Lifecycle Event)
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:35:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:36:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:04 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:36:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870554.4218469, 625f0d50-b25e-4542-863a-a65a8be8148d => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:36:09 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] VM Stopped (Lifecycle Event)
Sep 04 23:36:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1155d7b3-7345-4cc7-9ff6-d5f99cd4d0b5 None None] [instance: 625f0d50-b25e-4542-863a-a65a8be8148d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:36:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:36:10 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=6728MB free_disk=25.16014862060547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de97c8d3-65e0-4770-bf2b-44d58b5e403e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 56c16673-4ee4-41fe-a0a5-e92145477f66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:36:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:36:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:36:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lazy-loading 'flavor' on Instance uuid 56c16673-4ee4-41fe-a0a5-e92145477f66 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:18 user nova-compute[72954]: INFO nova.compute.manager [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Attaching volume 976a29a9-d4fa-4513-9589-58cbbcf47b5d to /dev/vdb
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.utils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[310bf569-d934-448c-86f1-4525ade9f4cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba74ac-80b7-46dd-ad05-3d3ca8b9d612]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9793f45f-828c-4e24-94d8-46a34c33dd3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3662b2-fba7-420a-a6ed-0316ce1caded]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:36:19 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:36:19 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a9171-7b67-4a6b-a139-5d89ab217c31]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG os_brick.utils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updating existing volume attachment record: 2fc184cc-1c68-4b9a-9d9b-0267da53567d {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:36:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:36:32 user nova-compute[72954]: INFO nova.compute.claims [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Claim successful on node user
Sep 04 23:36:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:36:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:36:33 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.policy [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e8428594834442899a2b76f7e52cc5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e836f28ced4b95946bb6a42b02513d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:36:33 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Creating image(s)
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "/opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "/opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk 1073741824" returned: 0 in 0.092s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Successfully created port: 95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:33 user nova-compute[72954]: INFO nova.compute.manager [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Terminating instance
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-27b1acce-b3f1-41ba-a1e6-0e5fa71231d3 req-3b1f6a3a-fa5d-4dc5-a128-cc8ed8361736 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-unplugged-751176c8-9875-4a16-9f95-f0391238238b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Cannot resize image /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Ensure instance console log exists: /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Successfully updated port: 95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:36:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Instance destroyed successfully.
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lazy-loading 'resources' on Instance uuid de97c8d3-65e0-4770-bf2b-44d58b5e403e {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquired lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1657404968',display_name='tempest-ServerStableDeviceRescueTest-server-1657404968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1657404968',id=4,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZgh255y/+LXAELpJV7eNBqpVnkHZDK1yywzwTsQ38F6MTWggrZ2S8iEHRQkGkIK43aM6t1SJqJQ3wOSWNVZ/R24frsfkYYdaBGggVzktpIfj2sOEhO9E+pt1BZRxKg0A==',key_name='tempest-keypair-121536044',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:33:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9de27ffc89c94fce98e145aeab3b1876',ramdisk_id='',reservation_id='r-ll2hgmty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-572734187',owner_user_name='tempest-ServerStableDeviceRescueTest-572734187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:35:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8355bdcc8c74030b0e977319cda578a',uuid=de97c8d3-65e0-4770-bf2b-44d58b5e403e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converting VIF {"id": "751176c8-9875-4a16-9f95-f0391238238b", "address": "fa:16:3e:26:d9:48", "network": {"id": "bed5da9f-93d0-4af3-b1b7-3cd510ea97e2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-932291819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9de27ffc89c94fce98e145aeab3b1876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751176c8-98", "ovs_interfaceid": "751176c8-9875-4a16-9f95-f0391238238b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG os_vif [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap751176c8-98, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-changed-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Refreshing instance network info cache due to event network-changed-95a08a35-3690-4ec9-8632-27a09fea24e6. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] Acquiring lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:36:34 user nova-compute[72954]: INFO os_vif [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:d9:48,bridge_name='br-int',has_traffic_filtering=True,id=751176c8-9875-4a16-9f95-f0391238238b,network=Network(bed5da9f-93d0-4af3-b1b7-3cd510ea97e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751176c8-98')
Sep 04 23:36:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Deleting instance files /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e_del
Sep 04 23:36:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Deletion of /opt/stack/data/nova/instances/de97c8d3-65e0-4770-bf2b-44d58b5e403e_del complete
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:36:34 user nova-compute[72954]: INFO nova.compute.manager [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Took 0.90 seconds to destroy the instance on the hypervisor.
Sep 04 23:36:34 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:36:34 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Updating instance_info_cache with network_info: [{"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Releasing lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Instance network_info: |[{"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] Acquired lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Refreshing network info cache for port 95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Start _get_guest_xml network_info=[{"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:36:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:36:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594356000',display_name='tempest-VolumesActionsTest-instance-1594356000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594356000',id=22,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2e836f28ced4b95946bb6a42b02513d',ramdisk_id='',reservation_id='r-q6qx5dce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1805885765',owner_user_name='tempest-VolumesActionsTest-1805885765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:36:33Z,user_data=None,user_id='6e8428594834442899a2b76f7e52cc5c',uuid=3b82885a-9eb7-42f7-96d4-4ee9312ca8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converting VIF {"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.objects.instance [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:36:35 user nova-compute[72954]:   <uuid>3b82885a-9eb7-42f7-96d4-4ee9312ca8a4</uuid>
Sep 04 23:36:35 user nova-compute[72954]:   <name>instance-00000016</name>
Sep 04 23:36:35 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:36:35 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:36:35 user nova-compute[72954]:   <metadata>
Sep 04 23:36:35 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:36:35 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:name>tempest-VolumesActionsTest-instance-1594356000</nova:name>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:36:35</nova:creationTime>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:36:35 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:36:35 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:owner>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:user uuid="6e8428594834442899a2b76f7e52cc5c">tempest-VolumesActionsTest-1805885765-project-member</nova:user>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:project uuid="a2e836f28ced4b95946bb6a42b02513d">tempest-VolumesActionsTest-1805885765</nova:project>
Sep 04 23:36:35 user nova-compute[72954]:       </nova:owner>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:36:35 user nova-compute[72954]:       <nova:ports>
Sep 04 23:36:35 user nova-compute[72954]:         <nova:port uuid="95a08a35-3690-4ec9-8632-27a09fea24e6">
Sep 04 23:36:35 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Sep 04 23:36:35 user nova-compute[72954]:         </nova:port>
Sep 04 23:36:35 user nova-compute[72954]:       </nova:ports>
Sep 04 23:36:35 user nova-compute[72954]:     </nova:instance>
Sep 04 23:36:35 user nova-compute[72954]:   </metadata>
Sep 04 23:36:35 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:36:35 user nova-compute[72954]:     <system>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="serial">3b82885a-9eb7-42f7-96d4-4ee9312ca8a4</entry>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="uuid">3b82885a-9eb7-42f7-96d4-4ee9312ca8a4</entry>
Sep 04 23:36:35 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:36:35 user nova-compute[72954]:     </system>
Sep 04 23:36:35 user nova-compute[72954]:   </sysinfo>
Sep 04 23:36:35 user nova-compute[72954]:   <os>
Sep 04 23:36:35 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:36:35 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:36:35 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:36:35 user nova-compute[72954]:   </os>
Sep 04 23:36:35 user nova-compute[72954]:   <features>
Sep 04 23:36:35 user nova-compute[72954]:     <acpi/>
Sep 04 23:36:35 user nova-compute[72954]:     <apic/>
Sep 04 23:36:35 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:36:35 user nova-compute[72954]:   </features>
Sep 04 23:36:35 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:36:35 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:36:35 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:36:35 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:36:35 user nova-compute[72954]:   </clock>
Sep 04 23:36:35 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:36:35 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:36:35 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:36:35 user nova-compute[72954]:   </cpu>
Sep 04 23:36:35 user nova-compute[72954]:   <devices>
Sep 04 23:36:35 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:36:35 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:36:35 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk"/>
Sep 04 23:36:35 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:36:35 user nova-compute[72954]:     </disk>
Sep 04 23:36:35 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:36:35 user nova-compute[72954]:       <mac address="fa:16:3e:88:4b:c1"/>
Sep 04 23:36:35 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:36:35 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:36:35 user nova-compute[72954]:       <target dev="tap95a08a35-36"/>
Sep 04 23:36:35 user nova-compute[72954]:     </interface>
Sep 04 23:36:35 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:36:35 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/console.log" append="off"/>
Sep 04 23:36:35 user nova-compute[72954]:     </serial>
Sep 04 23:36:35 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:36:35 user nova-compute[72954]:     <video>
Sep 04 23:36:35 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:36:35 user nova-compute[72954]:     </video>
Sep 04 23:36:35 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:36:35 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:36:35 user nova-compute[72954]:     </rng>
Sep 04 23:36:35 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:36:35 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:36:35 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:36:35 user nova-compute[72954]:     </memballoon>
Sep 04 23:36:35 user nova-compute[72954]:   </devices>
Sep 04 23:36:35 user nova-compute[72954]: </domain>
Sep 04 23:36:35 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594356000',display_name='tempest-VolumesActionsTest-instance-1594356000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594356000',id=22,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2e836f28ced4b95946bb6a42b02513d',ramdisk_id='',reservation_id='r-q6qx5dce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1805885765',owner_user_name='tempest-VolumesActionsTest-1805885765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:36:33Z,user_data=None,user_id='6e8428594834442899a2b76f7e52cc5c',uuid=3b82885a-9eb7-42f7-96d4-4ee9312ca8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converting VIF {"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG os_vif [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95a08a35-36, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95a08a35-36, col_values=(('external_ids', {'iface-id': '95a08a35-3690-4ec9-8632-27a09fea24e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:4b:c1', 'vm-uuid': '3b82885a-9eb7-42f7-96d4-4ee9312ca8a4'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:35 user nova-compute[72954]: INFO os_vif [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36')
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] No VIF found with MAC fa:16:3e:88:4b:c1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Updated VIF entry in instance network info cache for port 95a08a35-3690-4ec9-8632-27a09fea24e6. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Updating instance_info_cache with network_info: [{"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d3a032ec-1b34-4c1b-820c-517495c3499b req-088ca132-bc40-4275-8c12-facc193e23a9 service nova] Releasing lock "refresh_cache-3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:35 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Took 1.03 seconds to deallocate network for instance.
Sep 04 23:36:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] Acquiring lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] No waiting events found dispatching network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:36 user nova-compute[72954]: WARNING nova.compute.manager [req-7aab292e-0ec5-41c6-b29b-6901dd3e26b2 req-b80ccd9b-6da3-466b-a098-40aabc6730c3 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received unexpected event network-vif-plugged-751176c8-9875-4a16-9f95-f0391238238b for instance with vm_state deleted and task_state None.
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:36 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Deleted allocations for instance de97c8d3-65e0-4770-bf2b-44d58b5e403e
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-30de10a7-5dcd-43f0-b419-60ac089041e3 tempest-ServerStableDeviceRescueTest-572734187 tempest-ServerStableDeviceRescueTest-572734187-project-member] Lock "de97c8d3-65e0-4770-bf2b-44d58b5e403e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.622s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-825db173-8bd3-4f2d-b683-647aac263717 req-a4108778-6b6a-44a1-a466-91e4c2c78ce2 service nova] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Received event network-vif-deleted-751176c8-9875-4a16-9f95-f0391238238b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:36 user nova-compute[72954]: WARNING nova.compute.manager [req-40079393-60e5-44be-9c6b-7990d89b6b87 req-bb69cabd-cc37-49aa-9da4-65c929ff663f service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state building and task_state spawning.
Sep 04 23:36:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870598.720176, 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] VM Resumed (Lifecycle Event)
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Instance spawned successfully.
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870598.7244432, 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] VM Started (Lifecycle Event)
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:38 user nova-compute[72954]: WARNING nova.compute.manager [req-9578ff9f-4249-415d-887e-2ddcc8c2ea6b req-f70b3f2c-398f-4587-91cb-c6cba0abcfdf service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state building and task_state spawning.
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Took 5.67 seconds to spawn the instance on the hypervisor.
Sep 04 23:36:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:38 user nova-compute[72954]: INFO nova.compute.manager [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Took 6.44 seconds to build instance.
Sep 04 23:36:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-67f16b6e-feac-422e-981a-94ccc7452238 tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.551s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-changed-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Refreshing instance network info cache due to event network-changed-a1df8d1c-86a8-4f87-a770-5365dd719443. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] Acquiring lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] Acquired lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Refreshing network info cache for port a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG nova.objects.instance [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:41 user nova-compute[72954]: INFO nova.compute.manager [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Attaching volume d5ced50d-a4ff-4911-b758-5fb2468d1ffc to /dev/vdb
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.utils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7abde0-75e0-488c-9647-4f353395a0e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f25015-cb43-4c49-b8a8-380f41fcd284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4407a3c3-5252-4221-b61e-172a8287aa5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a0616-9563-465d-8f06-b1f6c480adc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:36:41 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:36:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e13b539-a72f-4b88-9427-84f8f6503447]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG os_brick.utils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:41 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating existing volume attachment record: 07e4d802-db9c-4938-8d2a-6fb398598073 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:36:42 user nova-compute[72954]: INFO nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Rebuilding instance
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updated VIF entry in instance network info cache for port a1df8d1c-86a8-4f87-a770-5365dd719443. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating instance_info_cache with network_info: [{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-160f74e3-892b-4f77-80a3-378cd21fa8fb req-b314776d-b94e-45ea-bbac-b74e21b8f41d service nova] Releasing lock "refresh_cache-82e7603c-406f-407f-8893-453c44ebd868" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:42 user nova-compute[72954]: WARNING nova.compute.manager [req-119401e0-ce1c-4ab5-8934-974c96686806 req-6db3530a-57fe-413c-a108-7ccbeda29e01 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state active and task_state rebuilding.
Sep 04 23:36:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFNxTblO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:42 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc80e5-6d42-49b0-9bf5-bfe74949cded]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:36:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a0d38-62ac-419b-b6ff-57a7738c0fa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d] added
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731b900-0ab5-4c2a-b4f8-d51d05ca4151]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5044b060-a973-435e-aad6-2d7b717b2149]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFNxTblO {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFNxTblO" returned: 0 in 0.090s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc4e120-7389-42ec-883b-0378bbb91e94]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFNxTblO'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f288c9e-6791-48b0-bce9-4ffd503b677f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1d013-ce31-4202-93a3-eb48412ecbf0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance destroyed successfully.
Sep 04 23:36:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance destroyed successfully.
Sep 04 23:36:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1261661191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1df8d1c-86, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:43 user nova-compute[72954]: INFO os_vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86')
Sep 04 23:36:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:43 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1138c9-7f04-4254-8a43-742c241cec8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260]
Sep 04 23:36:43 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260] successful.
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa38aa-c6f2-4686-84d7-e00eae777c4b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[89994367-19a3-4055-b1ee-63398d6bd2e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:43 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26404d9d-7992-4b28-bd07-3a95cc971f6f]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:36:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFNxTblO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26134653534613762', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653534613762', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.134s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lazy-loading 'flavor' on Instance uuid 56c16673-4ee4-41fe-a0a5-e92145477f66 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a86359c-9b85-4a65-bbbe-49a84a66eb05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:36:44 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:36:44 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:36:44 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:36:44 user nova-compute[72954]:   <serial>976a29a9-d4fa-4513-9589-58cbbcf47b5d</serial>
Sep 04 23:36:44 user nova-compute[72954]: </disk>
Sep 04 23:36:44 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f15115-5734-47c1-ac4e-2b02b4d1ef94]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:44 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1182bfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[55343c90-9deb-4922-a591-a66d8ab0ef18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd55310e-e732-4bd0-919e-eab8f339d5f7]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7c5553-15ee-4c08-a8fd-a8ca2a49c0bd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb1eb6-5cbe-4b4b-afff-db9aa91f430f]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca2c91-5201-4a2b-a902-06fa8019be58]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[433348ae-db5b-4430-8b36-908a4f9b670d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]
Sep 04 23:36:44 user nova-compute[72954]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.
Sep 04 23:36:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa4334-cef3-4cc8-98c0-70d97a87825e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== disconnect_volume: return (1468ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:36:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deleting instance files /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868_del
Sep 04 23:36:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deletion of /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868_del complete
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:44 user nova-compute[72954]: WARNING nova.compute.manager [req-cbac8a7c-e116-4568-96a7-a47e6db53882 req-155ac822-075d-4001-a6cf-b1b5292af7f7 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state active and task_state rebuilding.
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] No VIF found with MAC fa:16:3e:44:71:e1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:36:44 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 82e7603c-406f-407f-8893-453c44ebd868 could not be found.
Sep 04 23:36:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:36:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa07c5fe-6ecf-40b8-81bd-35ac6bd64c3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe054259-25fe-4d0e-b3d4-8b35c2ba9421]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:45 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:45 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:45 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:45 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130142680>, {}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Disconnecting from: [] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== disconnect_volume: return (63ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:36:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0c12572c-b573-4e0f-b3b3-32fba4f386dd tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.129s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:46 user nova-compute[72954]: INFO nova.compute.manager [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Terminating instance
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Instance destroyed successfully.
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lazy-loading 'resources' on Instance uuid 56c16673-4ee4-41fe-a0a5-e92145477f66 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-64698131',display_name='tempest-DeleteServersTestJSON-server-64698131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-64698131',id=17,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f2376c60a7a4de5b98eecdbe43a9b47',ramdisk_id='',reservation_id='r-nlo1sfpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2101815773',owner_user_name='tempest-DeleteServersTestJSON-2101815773-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:34:31Z,user_data=None,user_id='0c212fe7f0bd47eea32cf25d5d7e71fb',uuid=56c16673-4ee4-41fe-a0a5-e92145477f66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converting VIF {"id": "dd341f02-68bd-4220-aa11-72992cad137e", "address": "fa:16:3e:44:71:e1", "network": {"id": "d1a6f152-2069-4c12-9780-1910f1277062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-369858792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f2376c60a7a4de5b98eecdbe43a9b47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd341f02-68", "ovs_interfaceid": "dd341f02-68bd-4220-aa11-72992cad137e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_vif [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd341f02-68, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:46 user nova-compute[72954]: INFO os_vif [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:71:e1,bridge_name='br-int',has_traffic_filtering=True,id=dd341f02-68bd-4220-aa11-72992cad137e,network=Network(d1a6f152-2069-4c12-9780-1910f1277062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd341f02-68')
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFNxTblO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:46 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-unplugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] No waiting events found dispatching network-vif-unplugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-unplugged-dd341f02-68bd-4220-aa11-72992cad137e for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Acquiring lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] No waiting events found dispatching network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:36:46 user nova-compute[72954]: WARNING nova.compute.manager [req-352966ba-c58d-4d01-be4c-85f6cbe5d104 req-55acd69b-3130-4061-a207-3fbd0934ecff service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received unexpected event network-vif-plugged-dd341f02-68bd-4220-aa11-72992cad137e for instance with vm_state active and task_state deleting.
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb791280-984a-4cbc-87f5-7a39d9efccc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25142af-077e-4835-8c87-7b67eb1bae21]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:46 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:46 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:46 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:46 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:46 user nova-compute[72954]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d (non-flash)
Sep 04 23:36:46 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118349fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ef17f-7f73-488c-b7a3-1b1e186bcb75]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae8f110-4e27-48ad-9894-98829b6c1e39]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:36:46 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fee49e-0f93-49c4-a1d9-b13031b932ba]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a919ed36-e607-4ae7-9c53-3b8beb0a14f7]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80e014-8e35-4e71-b541-378edda3b092]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f0610a-9f0e-460d-ae0f-8b74100f1588]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260]
Sep 04 23:36:47 user nova-compute[72954]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d, portal: 172.16.0.220,3260] successful.
Sep 04 23:36:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976a29a9-d4fa-4513-9589-58cbbcf47b5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca9c886-e75d-4c32-bb18-a796c789be81]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] <== disconnect_volume: return (294ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:36:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Deleting instance files /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66_del
Sep 04 23:36:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Deletion of /opt/stack/data/nova/instances/56c16673-4ee4-41fe-a0a5-e92145477f66_del complete
Sep 04 23:36:47 user nova-compute[72954]: INFO nova.compute.manager [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Took 1.20 seconds to destroy the instance on the hypervisor.
Sep 04 23:36:47 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:47 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Took 0.56 seconds to deallocate network for instance.
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b7e1da6-d834-4c82-b243-272d04c1dfaf req-23f90d66-9b46-41e6-8158-5ba8b4e8fbba service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Received event network-vif-deleted-dd341f02-68bd-4220-aa11-72992cad137e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:36:47 user nova-compute[72954]: INFO nova.compute.manager [req-4b7e1da6-d834-4c82-b243-272d04c1dfaf req-23f90d66-9b46-41e6-8158-5ba8b4e8fbba service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Neutron deleted interface dd341f02-68bd-4220-aa11-72992cad137e; detaching it from the instance and deleting it from the info cache
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b7e1da6-d834-4c82-b243-272d04c1dfaf req-23f90d66-9b46-41e6-8158-5ba8b4e8fbba service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:36:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b7e1da6-d834-4c82-b243-272d04c1dfaf req-23f90d66-9b46-41e6-8158-5ba8b4e8fbba service nova] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Detach interface failed, port_id=dd341f02-68bd-4220-aa11-72992cad137e, reason: Instance 56c16673-4ee4-41fe-a0a5-e92145477f66 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:36:48 user nova-compute[72954]: INFO nova.compute.manager [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Took 0.93 seconds to detach 1 volumes for instance.
Sep 04 23:36:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:36:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:36:49 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:36:49 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:36:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:49 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Deleted allocations for instance 56c16673-4ee4-41fe-a0a5-e92145477f66
Sep 04 23:36:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7535be5d-e99a-403e-82e4-437456cc74ad tempest-DeleteServersTestJSON-2101815773 tempest-DeleteServersTestJSON-2101815773-project-member] Lock "56c16673-4ee4-41fe-a0a5-e92145477f66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.439s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:36:49 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870594.555941, de97c8d3-65e0-4770-bf2b-44d58b5e403e => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:36:49 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] VM Stopped (Lifecycle Event)
Sep 04 23:36:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-239f50ea-1bcc-42c0-85df-7e1c9f6dad14 None None] [instance: de97c8d3-65e0-4770-bf2b-44d58b5e403e] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:36:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:36:57 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc557d8-a0b8-4906-9276-d1f2da80e490]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:36:57 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419db34-e833-4a0b-a6ec-17556373470c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc] added
Sep 04 23:36:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84e10f-c205-4b63-9479-e7a7322205b6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d49754-d621-468a-9315-f84072092a96]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHrMLPv {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHrMLPv" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a258ec-f9e7-41de-8982-2edeb4db0d3a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkHrMLPv'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5f2a7b-08bb-4cc6-965e-bbc199756b8c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3856e-361d-4537-9b02-2d99d9dd13c3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:57 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:57 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a4b75-1d2e-4814-8e3e-d991c05e3189]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]
Sep 04 23:36:57 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.
Sep 04 23:36:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[05025583-87eb-4d09-9854-a418fdbb4d04]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2461d-f5ee-4ce7-bd30-28cf4ba8d179]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:58 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:58 user nova-compute[72954]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:36:58 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:36:58 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:36:58 user nova-compute[72954]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:36:58 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008d48f-1a98-4816-b97d-494bd4cea8a5]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:36:58 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870603.2283075, 82e7603c-406f-407f-8893-453c44ebd868 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:36:58 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Stopped (Lifecycle Event)
Sep 04 23:36:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9fc03c55-3cfe-475a-b752-ece0145b5672 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23433626132323630', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433626132323630', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.objects.instance [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:36:59 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:36:59 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:36:59 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:36:59 user nova-compute[72954]:   <serial>d5ced50d-a4ff-4911-b758-5fb2468d1ffc</serial>
Sep 04 23:36:59 user nova-compute[72954]: </disk>
Sep 04 23:36:59 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No VIF found with MAC fa:16:3e:a4:75:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:36:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-38cf50f6-08a1-4a76-9266-1182df0f648b tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.046s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Preparing to wait for external event volume-reimaged-2db09f32-5798-4b04-bda8-f9b151a9e3ad {{(pid=72954) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Sep 04 23:37:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:01 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870606.8320012, 56c16673-4ee4-41fe-a0a5-e92145477f66 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:01 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] VM Stopped (Lifecycle Event)
Sep 04 23:37:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-25e4e4c9-6d3d-49d6-adc2-55710075639d None None] [instance: 56c16673-4ee4-41fe-a0a5-e92145477f66] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:04 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:37:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:37:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7143MB free_disk=25.22774887084961GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:37:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:37:13 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing instance network info cache due to event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.network.neutron [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-changed-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Refreshing instance network info cache due to event network-changed-254899bf-9c89-46ea-8390-fed26be7c8cb. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG nova.network.neutron [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Refreshing network info cache for port 254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updated VIF entry in instance network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4c525f5c-f660-4ee8-8986-9f89a4297615 req-0774a009-c9c5-4932-a445-4f70b438b0cc service nova] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updated VIF entry in instance network info cache for port 254899bf-9c89-46ea-8390-fed26be7c8cb. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712240c4-31b6-4485-a233-43f6f66eff00 req-bf6c6708-3187-4a92-b55d-d9d7016ebe4a service nova] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing instance network info cache due to event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updated VIF entry in instance network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a61a2a13-8b4d-4ef5-9480-7349853453b8 req-87dffa9a-128b-412f-adc1-cd0be32f5a7e service nova] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-changed-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Refreshing instance network info cache due to event network-changed-28ca716a-b39a-4923-8261-36a8a99899cf. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Refreshing network info cache for port 28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updated VIF entry in instance network info cache for port 28ca716a-b39a-4923-8261-36a8a99899cf. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ad41369-9490-4f50-921f-5173d66c44d9 req-ea96a182-2607-45c1-a0d9-3c023de5837c service nova] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:23 user nova-compute[72954]: INFO nova.compute.manager [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Attaching volume 6c53c357-0db3-4331-baf4-28fb29394f95 to /dev/vdb
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.utils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ed0d5-308a-4c25-aac2-e1e53a3271ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f0da02-9f7a-4e7f-92dc-1cd1a379a6c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd01f0f5-b75c-40bf-af11-e6970e6d9ebd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89335db-8313-4203-9302-37e2b1d675fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:37:23 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:37:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f4594-83e7-49df-8a1b-c464ffe6db38]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG os_brick.utils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:37:23 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating existing volume attachment record: 60b3b976-f30f-488a-8922-96076c429def {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:37:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:25 user nova-compute[72954]: INFO nova.compute.manager [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Rebooting instance
Sep 04 23:37:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:26 user nova-compute[72954]: WARNING nova.compute.manager [req-1df6a7e9-92ab-4f3a-b3f1-cb434f5ed432 req-e2d7745f-bfe7-4561-ae93-9088c16a5421 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state active and task_state reboot_started_hard.
Sep 04 23:37:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance destroyed successfully.
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.objects.instance [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'resources' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:37:26Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6672997-a4, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:37:27 user nova-compute[72954]: INFO os_vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4')
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:37:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5c4d8-9dbd-40bd-a3f7-23b3f344e914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f0886c-c490-4414-bb84-80d65bd159db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:27 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:27 user nova-compute[72954]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:27 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:27 user nova-compute[72954]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13811f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f353f-6a59-4307-bac7-237d9a4f3f4c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d295ff94-1294-40c4-8109-cd5d789dabfe]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d247c4f-1f5c-4781-89e5-732734e3340f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f31b1-f90d-4ddc-8754-611ba7fd45e1]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[889334a6-3a03-48e5-80a9-cfd15c5c420b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6f3da-e66f-4ce1-bc05-216b0c887f3c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]
Sep 04 23:37:27 user nova-compute[72954]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.
Sep 04 23:37:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d63d8-ee0d-43b1-b898-9f7b2ddc8e78]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== disconnect_volume: return (324ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start _get_guest_xml network_info=[{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2a793278-a4dd-4fbf-b68b-be74cb827870,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '2a793278-a4dd-4fbf-b68b-be74cb827870'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a5e51f60-795c-4344-ac17-c7b5b9d9ad97', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5ced50d-a4ff-4911-b758-5fb2468d1ffc', 'serial': 'd5ced50d-a4ff-4911-b758-5fb2468d1ffc'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '07e4d802-db9c-4938-8d2a-6fb398598073', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:37:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2a793278-a4dd-4fbf-b68b-be74cb827870,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.objects.instance [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'vcpu_model' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.objects.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Object Instance<a5e51f60-795c-4344-ac17-c7b5b9d9ad97> lazy-loaded attributes: resources,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:37:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:37:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:37:27 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5e716e-c64c-4214-85e3-36ca5dc088f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:37:27 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1d464-3200-455a-8d64-4c42bc0403e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc] added
Sep 04 23:37:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.077s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a61c8-ba24-4f6e-86ca-12dd839ac9de]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb29d3e-1e34-4bae-8bd0-14db262cc860]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHrMLPv {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkHrMLPv" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21902bfd-6708-4c01-b745-d8c19b91cdaa]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkHrMLPv'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8179b2fb-1bae-4e11-947c-efca8426c552]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e94341b-9c91-4e9e-ac68-2ca0a485a329]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc91a72-5135-4fa1-9f87-569669eb06d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]
Sep 04 23:37:28 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.
Sep 04 23:37:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049aed4-7b21-4ba5-b3d3-07e2822478dd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a0f669-4ef6-4374-ab79-3ff1aa392c5c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:28 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e105cc72-3c8b-4da9-b50e-dae557b6d759]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:28 user nova-compute[72954]: WARNING nova.compute.manager [req-8abf3fa2-137d-4c71-b604-791b67791e3d req-8ae5452b-f5e4-4735-9a68-b85f81ffecef service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state active and task_state reboot_started_hard.
Sep 04 23:37:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23433626132323630', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433626132323630', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:37:26Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'pci_devices' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.objects.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Object Instance<a5e51f60-795c-4344-ac17-c7b5b9d9ad97> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:37:29 user nova-compute[72954]:   <uuid>a5e51f60-795c-4344-ac17-c7b5b9d9ad97</uuid>
Sep 04 23:37:29 user nova-compute[72954]:   <name>instance-00000012</name>
Sep 04 23:37:29 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:37:29 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:37:29 user nova-compute[72954]:   <metadata>
Sep 04 23:37:29 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:37:29 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:name>tempest-TestMinimumBasicScenario-server-1335181665</nova:name>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:37:27</nova:creationTime>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:37:29 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:37:29 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:owner>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:user uuid="b754b34e954e435a97130f83ef9d5622">tempest-TestMinimumBasicScenario-339041348-project-member</nova:user>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:project uuid="a4fc8d5e6302420a8056028f7c9bbdf6">tempest-TestMinimumBasicScenario-339041348</nova:project>
Sep 04 23:37:29 user nova-compute[72954]:       </nova:owner>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:root type="image" uuid="2a793278-a4dd-4fbf-b68b-be74cb827870"/>
Sep 04 23:37:29 user nova-compute[72954]:       <nova:ports>
Sep 04 23:37:29 user nova-compute[72954]:         <nova:port uuid="b6672997-a4c1-4cf8-acd9-5835c782a958">
Sep 04 23:37:29 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 04 23:37:29 user nova-compute[72954]:         </nova:port>
Sep 04 23:37:29 user nova-compute[72954]:       </nova:ports>
Sep 04 23:37:29 user nova-compute[72954]:     </nova:instance>
Sep 04 23:37:29 user nova-compute[72954]:   </metadata>
Sep 04 23:37:29 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:37:29 user nova-compute[72954]:     <system>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="serial">a5e51f60-795c-4344-ac17-c7b5b9d9ad97</entry>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="uuid">a5e51f60-795c-4344-ac17-c7b5b9d9ad97</entry>
Sep 04 23:37:29 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:37:29 user nova-compute[72954]:     </system>
Sep 04 23:37:29 user nova-compute[72954]:   </sysinfo>
Sep 04 23:37:29 user nova-compute[72954]:   <os>
Sep 04 23:37:29 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:37:29 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:37:29 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:37:29 user nova-compute[72954]:   </os>
Sep 04 23:37:29 user nova-compute[72954]:   <features>
Sep 04 23:37:29 user nova-compute[72954]:     <acpi/>
Sep 04 23:37:29 user nova-compute[72954]:     <apic/>
Sep 04 23:37:29 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:37:29 user nova-compute[72954]:   </features>
Sep 04 23:37:29 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:37:29 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:37:29 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:37:29 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:37:29 user nova-compute[72954]:   </clock>
Sep 04 23:37:29 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:37:29 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:37:29 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:37:29 user nova-compute[72954]:   </cpu>
Sep 04 23:37:29 user nova-compute[72954]:   <devices>
Sep 04 23:37:29 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:37:29 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:37:29 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk"/>
Sep 04 23:37:29 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:37:29 user nova-compute[72954]:     </disk>
Sep 04 23:37:29 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:37:29 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:37:29 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:37:29 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:37:29 user nova-compute[72954]:       <serial>d5ced50d-a4ff-4911-b758-5fb2468d1ffc</serial>
Sep 04 23:37:29 user nova-compute[72954]:     </disk>
Sep 04 23:37:29 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:37:29 user nova-compute[72954]:       <mac address="fa:16:3e:a4:75:3a"/>
Sep 04 23:37:29 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:29 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:37:29 user nova-compute[72954]:       <target dev="tapb6672997-a4"/>
Sep 04 23:37:29 user nova-compute[72954]:     </interface>
Sep 04 23:37:29 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:37:29 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/console.log" append="off"/>
Sep 04 23:37:29 user nova-compute[72954]:     </serial>
Sep 04 23:37:29 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:37:29 user nova-compute[72954]:     <video>
Sep 04 23:37:29 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:29 user nova-compute[72954]:     </video>
Sep 04 23:37:29 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:37:29 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:37:29 user nova-compute[72954]:     </rng>
Sep 04 23:37:29 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:37:29 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:37:29 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:37:29 user nova-compute[72954]:     </memballoon>
Sep 04 23:37:29 user nova-compute[72954]:   </devices>
Sep 04 23:37:29 user nova-compute[72954]: </domain>
Sep 04 23:37:29 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'trusted_certs' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.objects.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Object Instance<a5e51f60-795c-4344-ac17-c7b5b9d9ad97> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:37:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Cannot resize image /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'migration_context' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.objects.base [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Object Instance<a5e51f60-795c-4344-ac17-c7b5b9d9ad97> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:26Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG os_vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6672997-a4, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6672997-a4, col_values=(('external_ids', {'iface-id': 'b6672997-a4c1-4cf8-acd9-5835c782a958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:75:3a', 'vm-uuid': 'a5e51f60-795c-4344-ac17-c7b5b9d9ad97'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:37:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:30 user nova-compute[72954]: INFO os_vif [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4')
Sep 04 23:37:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:32 user nova-compute[72954]: WARNING nova.compute.manager [req-e7d198cf-c7b1-40b9-94ab-cfb29c96d573 req-25738056-611d-46d3-bc77-0ea846eefd07 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state active and task_state reboot_started_hard.
Sep 04 23:37:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:34 user nova-compute[72954]: WARNING nova.compute.manager [req-ffb4dab8-08ad-4188-ad42-ca9fb3e0fe84 req-de1a5ce5-2107-49d9-8baa-2fb4782b4be8 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state active and task_state reboot_started_hard.
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for a5e51f60-795c-4344-ac17-c7b5b9d9ad97 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870654.185412, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:34 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] VM Resumed (Lifecycle Event)
Sep 04 23:37:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance rebooted successfully.
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:34 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870654.1858068, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:34 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] VM Started (Lifecycle Event)
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-479e0d57-baa1-4974-98be-bd9309a2f3e9 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.698s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:37:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:37:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:37:42 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8dfabe-fc91-45ff-ad69-21450bba3766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:37:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf3bd9-af32-4238-99a1-aedba938482d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95] added
Sep 04 23:37:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6babf20b-884e-4172-a9b4-289206ebdf19]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446f0d3-e1a5-463e-8d75-21bc0f8bf553]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkuUtgfp {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkuUtgfp" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437a192-139b-4ebc-a79c-c06a48bf2c04]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jkuUtgfp'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595ad48-55d0-4311-8a7e-f84ed617e220]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa7e73-6ec3-45c1-a158-2866a4800694]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:42 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:42 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:42 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:42 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:37:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d751e0a-5064-49c3-a3a8-c6bfa0b9f65c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]
Sep 04 23:37:43 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.
Sep 04 23:37:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8aae32-90bd-4175-ae2e-6c9cc699b3e1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeee285-05a4-4f44-82db-9dc92f80bae2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:37:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:37:43 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:37:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d0192-6d6d-4e97-9165-1077332e5706]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:37:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26630633366663762', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633366663762', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:37:44 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:37:44 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:37:44 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:37:44 user nova-compute[72954]:   <serial>6c53c357-0db3-4331-baf4-28fb29394f95</serial>
Sep 04 23:37:44 user nova-compute[72954]: </disk>
Sep 04 23:37:44 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No VIF found with MAC fa:16:3e:d0:ea:8a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:37:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6f89b72-cd7f-4832-b41e-0ee3cdad5f27 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.315s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72954) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG nova.objects.instance [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:46 user nova-compute[72954]: WARNING nova.compute.manager [req-4ef561b1-70fc-40db-9772-55daec829e7d req-d437bb85-8f5e-4e1b-8f99-b73b27970c5d service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state active and task_state powering-off.
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:37:46 user nova-compute[72954]: INFO nova.compute.claims [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Claim successful on node user
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance destroyed successfully.
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-881231a2-fb42-43be-9350-cfae258b5ed3 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.009s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.772s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.570s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:37:46 user nova-compute[72954]: INFO nova.compute.claims [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Claim successful on node user
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:37:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.policy [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90f45a06454ddaa392e6cbfe58eeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4c625d90e54690b8cbb9d0c4cd6e54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:37:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Creating image(s)
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "/opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "/opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk 1073741824" returned: 0 in 0.124s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Successfully created port: 96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:37:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:37:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.320s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:48 user nova-compute[72954]: WARNING nova.compute.manager [req-98079abe-7226-4623-ab73-1a4f40b4fa63 req-646548e9-7eb8-4e9f-accd-ea02907e018e service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state None.
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.policy [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84a77f46b55f4de2aac8145636dda0b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8caf44b9944100837bfc22addb20d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:37:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Creating image(s)
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Cannot resize image /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Ensure instance console log exists: /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.283s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.264s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk 1073741824" returned: 0 in 0.116s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Cannot resize image /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Ensure instance console log exists: /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Successfully updated port: 96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:37:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Successfully created port: b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-changed-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Refreshing instance network info cache due to event network-changed-96ec8726-41b0-410b-85fe-175cc9623ca5. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] Acquiring lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.neutron [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Updating instance_info_cache with network_info: [{"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Instance network_info: |[{"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] Acquired lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.neutron [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Refreshing network info cache for port 96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Start _get_guest_xml network_info=[{"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:37:50 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:50 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2093926272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2093926272',id=23,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5mtfvwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:47Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=07911333-3216-4cc3-839e-e29f1f561ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'pci_devices' on Instance uuid 07911333-3216-4cc3-839e-e29f1f561ee1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:37:50 user nova-compute[72954]:   <uuid>07911333-3216-4cc3-839e-e29f1f561ee1</uuid>
Sep 04 23:37:50 user nova-compute[72954]:   <name>instance-00000017</name>
Sep 04 23:37:50 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:37:50 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:37:50 user nova-compute[72954]:   <metadata>
Sep 04 23:37:50 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:37:50 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2093926272</nova:name>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:37:50</nova:creationTime>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:37:50 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:37:50 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:owner>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:user uuid="9f90f45a06454ddaa392e6cbfe58eeca">tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member</nova:user>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:project uuid="cf4c625d90e54690b8cbb9d0c4cd6e54">tempest-ServerBootFromVolumeStableRescueTest-974522082</nova:project>
Sep 04 23:37:50 user nova-compute[72954]:       </nova:owner>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:37:50 user nova-compute[72954]:       <nova:ports>
Sep 04 23:37:50 user nova-compute[72954]:         <nova:port uuid="96ec8726-41b0-410b-85fe-175cc9623ca5">
Sep 04 23:37:50 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:37:50 user nova-compute[72954]:         </nova:port>
Sep 04 23:37:50 user nova-compute[72954]:       </nova:ports>
Sep 04 23:37:50 user nova-compute[72954]:     </nova:instance>
Sep 04 23:37:50 user nova-compute[72954]:   </metadata>
Sep 04 23:37:50 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:37:50 user nova-compute[72954]:     <system>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="serial">07911333-3216-4cc3-839e-e29f1f561ee1</entry>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="uuid">07911333-3216-4cc3-839e-e29f1f561ee1</entry>
Sep 04 23:37:50 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:37:50 user nova-compute[72954]:     </system>
Sep 04 23:37:50 user nova-compute[72954]:   </sysinfo>
Sep 04 23:37:50 user nova-compute[72954]:   <os>
Sep 04 23:37:50 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:37:50 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:37:50 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:37:50 user nova-compute[72954]:   </os>
Sep 04 23:37:50 user nova-compute[72954]:   <features>
Sep 04 23:37:50 user nova-compute[72954]:     <acpi/>
Sep 04 23:37:50 user nova-compute[72954]:     <apic/>
Sep 04 23:37:50 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:37:50 user nova-compute[72954]:   </features>
Sep 04 23:37:50 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:37:50 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:37:50 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:37:50 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:37:50 user nova-compute[72954]:   </clock>
Sep 04 23:37:50 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:37:50 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:37:50 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:37:50 user nova-compute[72954]:   </cpu>
Sep 04 23:37:50 user nova-compute[72954]:   <devices>
Sep 04 23:37:50 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:37:50 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:37:50 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk"/>
Sep 04 23:37:50 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:37:50 user nova-compute[72954]:     </disk>
Sep 04 23:37:50 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:37:50 user nova-compute[72954]:       <mac address="fa:16:3e:3c:6a:0a"/>
Sep 04 23:37:50 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:50 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:37:50 user nova-compute[72954]:       <target dev="tap96ec8726-41"/>
Sep 04 23:37:50 user nova-compute[72954]:     </interface>
Sep 04 23:37:50 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:37:50 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/console.log" append="off"/>
Sep 04 23:37:50 user nova-compute[72954]:     </serial>
Sep 04 23:37:50 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:37:50 user nova-compute[72954]:     <video>
Sep 04 23:37:50 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:50 user nova-compute[72954]:     </video>
Sep 04 23:37:50 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:37:50 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:37:50 user nova-compute[72954]:     </rng>
Sep 04 23:37:50 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:37:50 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:37:50 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:37:50 user nova-compute[72954]:     </memballoon>
Sep 04 23:37:50 user nova-compute[72954]:   </devices>
Sep 04 23:37:50 user nova-compute[72954]: </domain>
Sep 04 23:37:50 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2093926272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2093926272',id=23,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5mtfvwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:47Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=07911333-3216-4cc3-839e-e29f1f561ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG os_vif [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ec8726-41, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96ec8726-41, col_values=(('external_ids', {'iface-id': '96ec8726-41b0-410b-85fe-175cc9623ca5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:6a:0a', 'vm-uuid': '07911333-3216-4cc3-839e-e29f1f561ee1'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:50 user nova-compute[72954]: INFO os_vif [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41')
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:37:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] No VIF found with MAC fa:16:3e:3c:6a:0a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Updated VIF entry in instance network info cache for port 96ec8726-41b0-410b-85fe-175cc9623ca5. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Updating instance_info_cache with network_info: [{"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Successfully updated port: b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e2888a7d-4f88-46a8-bd24-3506634b74d7 req-a3460541-d0ba-467f-b4db-401a0515605a service nova] Releasing lock "refresh_cache-07911333-3216-4cc3-839e-e29f1f561ee1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance network_info: |[{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start _get_guest_xml network_info=[{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:37:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:51 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:37:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436359465',display_name='tempest-ServerRescueNegativeTestJSON-server-436359465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436359465',id=24,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU+3donveUiSkzIO5j0s3zuZeAeSf15n6hkRBW8qYDZ7MYb7k62h8LVfhyHdlafg0Ham4nmkKJCW8CSTZ4st9cFiWSwUhfRffy/8YBP6NH3TgSXUYxLDtRcUEpq1ShrdQ==',key_name='tempest-keypair-1968450403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-mm7pnk05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c88b8e02-ab4d-4c55-8e32-d61e8674121c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:37:52 user nova-compute[72954]:   <uuid>c88b8e02-ab4d-4c55-8e32-d61e8674121c</uuid>
Sep 04 23:37:52 user nova-compute[72954]:   <name>instance-00000018</name>
Sep 04 23:37:52 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:37:52 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:37:52 user nova-compute[72954]:   <metadata>
Sep 04 23:37:52 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:37:52 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-436359465</nova:name>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:37:51</nova:creationTime>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:37:52 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:37:52 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:owner>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:37:52 user nova-compute[72954]:       </nova:owner>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:37:52 user nova-compute[72954]:       <nova:ports>
Sep 04 23:37:52 user nova-compute[72954]:         <nova:port uuid="b2eaacb4-91c4-4585-927e-80930137fe18">
Sep 04 23:37:52 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 04 23:37:52 user nova-compute[72954]:         </nova:port>
Sep 04 23:37:52 user nova-compute[72954]:       </nova:ports>
Sep 04 23:37:52 user nova-compute[72954]:     </nova:instance>
Sep 04 23:37:52 user nova-compute[72954]:   </metadata>
Sep 04 23:37:52 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:37:52 user nova-compute[72954]:     <system>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="serial">c88b8e02-ab4d-4c55-8e32-d61e8674121c</entry>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="uuid">c88b8e02-ab4d-4c55-8e32-d61e8674121c</entry>
Sep 04 23:37:52 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:37:52 user nova-compute[72954]:     </system>
Sep 04 23:37:52 user nova-compute[72954]:   </sysinfo>
Sep 04 23:37:52 user nova-compute[72954]:   <os>
Sep 04 23:37:52 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:37:52 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:37:52 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:37:52 user nova-compute[72954]:   </os>
Sep 04 23:37:52 user nova-compute[72954]:   <features>
Sep 04 23:37:52 user nova-compute[72954]:     <acpi/>
Sep 04 23:37:52 user nova-compute[72954]:     <apic/>
Sep 04 23:37:52 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:37:52 user nova-compute[72954]:   </features>
Sep 04 23:37:52 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:37:52 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:37:52 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:37:52 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:37:52 user nova-compute[72954]:   </clock>
Sep 04 23:37:52 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:37:52 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:37:52 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:37:52 user nova-compute[72954]:   </cpu>
Sep 04 23:37:52 user nova-compute[72954]:   <devices>
Sep 04 23:37:52 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:37:52 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:37:52 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk"/>
Sep 04 23:37:52 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:37:52 user nova-compute[72954]:     </disk>
Sep 04 23:37:52 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:37:52 user nova-compute[72954]:       <mac address="fa:16:3e:ee:c4:e6"/>
Sep 04 23:37:52 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:52 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:37:52 user nova-compute[72954]:       <target dev="tapb2eaacb4-91"/>
Sep 04 23:37:52 user nova-compute[72954]:     </interface>
Sep 04 23:37:52 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:37:52 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/console.log" append="off"/>
Sep 04 23:37:52 user nova-compute[72954]:     </serial>
Sep 04 23:37:52 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:37:52 user nova-compute[72954]:     <video>
Sep 04 23:37:52 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:37:52 user nova-compute[72954]:     </video>
Sep 04 23:37:52 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:37:52 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:37:52 user nova-compute[72954]:     </rng>
Sep 04 23:37:52 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:37:52 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:37:52 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:37:52 user nova-compute[72954]:     </memballoon>
Sep 04 23:37:52 user nova-compute[72954]:   </devices>
Sep 04 23:37:52 user nova-compute[72954]: </domain>
Sep 04 23:37:52 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436359465',display_name='tempest-ServerRescueNegativeTestJSON-server-436359465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436359465',id=24,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU+3donveUiSkzIO5j0s3zuZeAeSf15n6hkRBW8qYDZ7MYb7k62h8LVfhyHdlafg0Ham4nmkKJCW8CSTZ4st9cFiWSwUhfRffy/8YBP6NH3TgSXUYxLDtRcUEpq1ShrdQ==',key_name='tempest-keypair-1968450403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-mm7pnk05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c88b8e02-ab4d-4c55-8e32-d61e8674121c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG os_vif [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2eaacb4-91, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2eaacb4-91, col_values=(('external_ids', {'iface-id': 'b2eaacb4-91c4-4585-927e-80930137fe18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:c4:e6', 'vm-uuid': 'c88b8e02-ab4d-4c55-8e32-d61e8674121c'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: INFO os_vif [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91')
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:ee:c4:e6, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing instance network info cache due to event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] No waiting events found dispatching network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:52 user nova-compute[72954]: WARNING nova.compute.manager [req-6192dbc2-d275-40d6-8916-a94e30a755de req-d6310b57-39bf-437c-9b89-183c10ff0dff service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received unexpected event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 for instance with vm_state building and task_state spawning.
Sep 04 23:37:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updated VIF entry in instance network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:37:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be895cec-22c0-4b99-94d5-ea61f753b73d req-115bfb60-22f4-4550-bc84-382ce19c2035 service nova] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:37:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] No waiting events found dispatching network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:54 user nova-compute[72954]: WARNING nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received unexpected event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 for instance with vm_state building and task_state spawning.
Sep 04 23:37:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:54 user nova-compute[72954]: WARNING nova.compute.manager [req-dfd53afc-c231-4795-9d74-3eda34bcabdd req-d3ff5d55-ebf3-47a5-8a7d-3b6b787905a1 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state building and task_state spawning.
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870675.5510328, 07911333-3216-4cc3-839e-e29f1f561ee1 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] VM Resumed (Lifecycle Event)
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Instance spawned successfully.
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870675.551755, 07911333-3216-4cc3-839e-e29f1f561ee1 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] VM Started (Lifecycle Event)
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Took 8.39 seconds to spawn the instance on the hypervisor.
Sep 04 23:37:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:55 user nova-compute[72954]: INFO nova.compute.manager [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Took 9.68 seconds to build instance.
Sep 04 23:37:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-72b55f7d-79f4-46f3-afbf-678142f55940 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.816s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870676.1572216, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Resumed (Lifecycle Event)
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance spawned successfully.
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870676.163325, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Started (Lifecycle Event)
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Took 8.11 seconds to spawn the instance on the hypervisor.
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:37:56 user nova-compute[72954]: INFO nova.compute.manager [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Took 10.15 seconds to build instance.
Sep 04 23:37:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fef2aefd-9f69-46b4-8d82-8868485fdccf tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.367s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:37:56 user nova-compute[72954]: WARNING nova.compute.manager [req-28751cfe-d3d9-4ce9-8863-576e3217573c req-1ed95125-0764-48e3-909e-9784c2a9dcc3 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state active and task_state None.
Sep 04 23:37:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 req-dc9b87da-e5b0-4004-9cdd-108d5a5d6e2e service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event volume-reimaged-2db09f32-5798-4b04-bda8-f9b151a9e3ad {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 req-dc9b87da-e5b0-4004-9cdd-108d5a5d6e2e service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 req-dc9b87da-e5b0-4004-9cdd-108d5a5d6e2e service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 req-dc9b87da-e5b0-4004-9cdd-108d5a5d6e2e service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 req-dc9b87da-e5b0-4004-9cdd-108d5a5d6e2e service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Processing event volume-reimaged-2db09f32-5798-4b04-bda8-f9b151a9e3ad {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10868}}
Sep 04 23:37:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance event wait completed in 59 seconds for volume-reimaged {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:37:59 user nova-compute[72954]: INFO nova.virt.block_device [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Booting with volume 2db09f32-5798-4b04-bda8-f9b151a9e3ad at /dev/vda
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.utils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeef6efa-2fc8-43d5-a8d9-dffa99ffed67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea4a331-e2c0-4cab-a98a-0301c2305dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c139e16-aaab-4480-87ea-799effb737fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92cf7e9-59fc-41fa-9782-8426a10c7f95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:38:00 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:38:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ccaadc-f3be-41e4-9f49-a8e1a4367fcd]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG os_brick.utils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:38:00 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating existing volume attachment record: d9832b8c-0d70-447a-b4fe-960fcddeddd3 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:38:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:01 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870666.410869, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:01 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Stopped (Lifecycle Event)
Sep 04 23:38:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2907a582-2a71-4b3d-90f2-970281c4a24b None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2907a582-2a71-4b3d-90f2-970281c4a24b None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:38:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:05 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:05 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:38:08 user nova-compute[72954]: INFO nova.compute.claims [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Claim successful on node user
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:38:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.policy [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e70c64a167d478a82d96dce40a11a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dec2432d9404b94f2f5f16ab0c193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:38:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Creating image(s)
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "/opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "/opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "/opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.262s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk 1073741824" returned: 0 in 0.088s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Successfully created port: 20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.266s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Cannot resize image /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Ensure instance console log exists: /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Successfully updated port: 20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquired lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-changed-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Refreshing instance network info cache due to event network-changed-20acd0d0-956c-4af7-9ce2-5918a7678207. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] Acquiring lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Updating instance_info_cache with network_info: [{"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Releasing lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Instance network_info: |[{"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] Acquired lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.neutron [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Refreshing network info cache for port 20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Start _get_guest_xml network_info=[{"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:38:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:38:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-375058730',display_name='tempest-ServersNegativeTestJSON-server-375058730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-375058730',id=25,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-0yptab3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:38:09Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=6605195e-6cd2-4fe7-9fb0-786a25557498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lazy-loading 'pci_devices' on Instance uuid 6605195e-6cd2-4fe7-9fb0-786a25557498 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:38:11 user nova-compute[72954]:   <uuid>6605195e-6cd2-4fe7-9fb0-786a25557498</uuid>
Sep 04 23:38:11 user nova-compute[72954]:   <name>instance-00000019</name>
Sep 04 23:38:11 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:38:11 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:38:11 user nova-compute[72954]:   <metadata>
Sep 04 23:38:11 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:38:11 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:name>tempest-ServersNegativeTestJSON-server-375058730</nova:name>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:38:11</nova:creationTime>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:38:11 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:38:11 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:owner>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:user uuid="8e70c64a167d478a82d96dce40a11a8e">tempest-ServersNegativeTestJSON-817858437-project-member</nova:user>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:project uuid="537dec2432d9404b94f2f5f16ab0c193">tempest-ServersNegativeTestJSON-817858437</nova:project>
Sep 04 23:38:11 user nova-compute[72954]:       </nova:owner>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:38:11 user nova-compute[72954]:       <nova:ports>
Sep 04 23:38:11 user nova-compute[72954]:         <nova:port uuid="20acd0d0-956c-4af7-9ce2-5918a7678207">
Sep 04 23:38:11 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 04 23:38:11 user nova-compute[72954]:         </nova:port>
Sep 04 23:38:11 user nova-compute[72954]:       </nova:ports>
Sep 04 23:38:11 user nova-compute[72954]:     </nova:instance>
Sep 04 23:38:11 user nova-compute[72954]:   </metadata>
Sep 04 23:38:11 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:38:11 user nova-compute[72954]:     <system>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="serial">6605195e-6cd2-4fe7-9fb0-786a25557498</entry>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="uuid">6605195e-6cd2-4fe7-9fb0-786a25557498</entry>
Sep 04 23:38:11 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:38:11 user nova-compute[72954]:     </system>
Sep 04 23:38:11 user nova-compute[72954]:   </sysinfo>
Sep 04 23:38:11 user nova-compute[72954]:   <os>
Sep 04 23:38:11 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:38:11 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:38:11 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:38:11 user nova-compute[72954]:   </os>
Sep 04 23:38:11 user nova-compute[72954]:   <features>
Sep 04 23:38:11 user nova-compute[72954]:     <acpi/>
Sep 04 23:38:11 user nova-compute[72954]:     <apic/>
Sep 04 23:38:11 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:38:11 user nova-compute[72954]:   </features>
Sep 04 23:38:11 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:38:11 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:38:11 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:38:11 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:38:11 user nova-compute[72954]:   </clock>
Sep 04 23:38:11 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:38:11 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:38:11 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:38:11 user nova-compute[72954]:   </cpu>
Sep 04 23:38:11 user nova-compute[72954]:   <devices>
Sep 04 23:38:11 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:38:11 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:38:11 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk"/>
Sep 04 23:38:11 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:38:11 user nova-compute[72954]:     </disk>
Sep 04 23:38:11 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:38:11 user nova-compute[72954]:       <mac address="fa:16:3e:bf:b7:f7"/>
Sep 04 23:38:11 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:38:11 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:38:11 user nova-compute[72954]:       <target dev="tap20acd0d0-95"/>
Sep 04 23:38:11 user nova-compute[72954]:     </interface>
Sep 04 23:38:11 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:38:11 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/console.log" append="off"/>
Sep 04 23:38:11 user nova-compute[72954]:     </serial>
Sep 04 23:38:11 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:38:11 user nova-compute[72954]:     <video>
Sep 04 23:38:11 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:38:11 user nova-compute[72954]:     </video>
Sep 04 23:38:11 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:38:11 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:38:11 user nova-compute[72954]:     </rng>
Sep 04 23:38:11 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:38:11 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:38:11 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:38:11 user nova-compute[72954]:     </memballoon>
Sep 04 23:38:11 user nova-compute[72954]:   </devices>
Sep 04 23:38:11 user nova-compute[72954]: </domain>
Sep 04 23:38:11 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-375058730',display_name='tempest-ServersNegativeTestJSON-server-375058730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-375058730',id=25,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-0yptab3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:38:09Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=6605195e-6cd2-4fe7-9fb0-786a25557498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG os_vif [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20acd0d0-95, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20acd0d0-95, col_values=(('external_ids', {'iface-id': '20acd0d0-956c-4af7-9ce2-5918a7678207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:b7:f7', 'vm-uuid': '6605195e-6cd2-4fe7-9fb0-786a25557498'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:12 user nova-compute[72954]: INFO os_vif [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95')
Sep 04 23:38:12 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:38:12 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7206MB free_disk=25.210323333740234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] No VIF found with MAC fa:16:3e:bf:b7:f7, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 07911333-3216-4cc3-839e-e29f1f561ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Updated VIF entry in instance network info cache for port 20acd0d0-956c-4af7-9ce2-5918a7678207. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Updating instance_info_cache with network_info: [{"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b4835d7e-b256-4cd4-851c-5f4113d7fea1 req-c00e1dc1-b871-4506-85f7-7c76b8f666c6 service nova] Releasing lock "refresh_cache-6605195e-6cd2-4fe7-9fb0-786a25557498" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:12 user nova-compute[72954]: INFO nova.compute.manager [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Detaching volume 2821c146-33ea-4f06-a02a-9ae77990dd4a
Sep 04 23:38:12 user nova-compute[72954]: INFO nova.virt.block_device [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Attempting to driver detach volume 2821c146-33ea-4f06-a02a-9ae77990dd4a from mountpoint /dev/vdb
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Attempting to detach device vdb from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:38:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:38:12 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:38:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:38:12 user nova-compute[72954]:   <serial>2821c146-33ea-4f06-a02a-9ae77990dd4a</serial>
Sep 04 23:38:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:38:12 user nova-compute[72954]: </disk>
Sep 04 23:38:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:38:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully detached device vdb from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the persistent domain config.
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:38:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:38:12 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:38:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:38:12 user nova-compute[72954]:   <serial>2821c146-33ea-4f06-a02a-9ae77990dd4a</serial>
Sep 04 23:38:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:38:12 user nova-compute[72954]: </disk>
Sep 04 23:38:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:38:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870693.2029235, 98b7e205-7840-4e98-9f69-2cf6e7142202 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:38:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully detached device vdb from instance 98b7e205-7840-4e98-9f69-2cf6e7142202 from the live domain config.
Sep 04 23:38:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCIdjGBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:38:13 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d205b7-603f-4acd-b3fa-80c2364e024c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c91c1-85c0-4898-a659-96e8594b848f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:13 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130388280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f127a1-43ec-4c57-9ba9-05c4c8308f3f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[920a9eaf-aafe-4155-91b4-4023e5dfef1a]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f53cd1a-ed0a-4a87-88d2-e04f544e2648]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a90c51-8714-4ed0-869a-77f7c961718a]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa954b49-0674-45c5-87e2-15c69e2eb35b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d986220b-b872-4991-933a-e07a62d276dd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260]
Sep 04 23:38:13 user nova-compute[72954]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a, portal: 172.16.0.220,3260] successful.
Sep 04 23:38:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2821c146-33ea-4f06-a02a-9ae77990dd4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d01998-6062-4e66-b5a7-5ed5832e5b11]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== disconnect_volume: return (306ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:14 user nova-compute[72954]: WARNING nova.compute.manager [req-22b5b0eb-7d0f-4123-b9af-95f3e8f56405 req-6d808c5d-3665-42d7-9be0-98499d1e9b59 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received unexpected event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with vm_state building and task_state spawning.
Sep 04 23:38:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'flavor' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b4c0d0e-4e77-4456-973f-e1f0096c6f35 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.152s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:38:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:16 user nova-compute[72954]: WARNING nova.compute.manager [req-a6b3a018-b50d-4f68-a09b-a740f1f9d3c5 req-5cba9b48-ac7f-45ff-ab87-8c2c8ce43785 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received unexpected event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with vm_state building and task_state spawning.
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870696.445908, 6605195e-6cd2-4fe7-9fb0-786a25557498 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] VM Resumed (Lifecycle Event)
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Instance spawned successfully.
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870696.4496872, 6605195e-6cd2-4fe7-9fb0-786a25557498 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] VM Started (Lifecycle Event)
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [{"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-c15ab7fd-25fc-42ba-a451-c91cfe60c884" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Took 7.13 seconds to spawn the instance on the hypervisor.
Sep 04 23:38:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:16 user nova-compute[72954]: INFO nova.compute.manager [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Took 8.58 seconds to build instance.
Sep 04 23:38:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-93db2e62-89d6-40fd-beec-90ef547f9fb5 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.719s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:38:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Creating image(s)
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Ensure instance console log exists: /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start _get_guest_xml network_info=[{"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82e7603c-406f-407f-8893-453c44ebd868', 'attached_at': '', 'detached_at': '', 'volume_id': '2db09f32-5798-4b04-bda8-f9b151a9e3ad', 'serial': '2db09f32-5798-4b04-bda8-f9b151a9e3ad'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd9832b8c-0d70-447a-b4fe-960fcddeddd3', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:38:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Sep 04 23:38:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.objects.instance [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82e7603c-406f-407f-8893-453c44ebd868 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:38:18 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:38:18 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:38:18 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d55005-21c9-441b-b676-5dd86cba55af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:38:18 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdeb9f4-3f70-44b7-9570-82423d6b8fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad] added
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd898fe-1711-4d01-aca1-7bb02655e542]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7d83e-d2d3-427c-8717-0a9d1f0fc7e1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FchOQmvI {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FchOQmvI" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f3f1ba-bf9f-4dc2-83ec-ba985226d2cb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FchOQmvI'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6b5df-11c0-47b6-b6b0-a471b1c70ebe]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe8eff-510d-488e-b002-6e2bebe7ecc0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b7e3d-a818-4a0c-b6bc-56d179c27277]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]
Sep 04 23:38:18 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc7d04-b184-491d-90d5-dd07e0f750bc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0b3ec-05d5-40b3-9b5a-a476bc777c34]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:38:18 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:38:18 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515a573-3d37-4881-878a-e39720c0d862]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:38:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26631626538663532', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631626538663532', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1261661191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:38:19 user nova-compute[72954]:   <uuid>82e7603c-406f-407f-8893-453c44ebd868</uuid>
Sep 04 23:38:19 user nova-compute[72954]:   <name>instance-00000013</name>
Sep 04 23:38:19 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:38:19 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:38:19 user nova-compute[72954]:   <metadata>
Sep 04 23:38:19 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:38:19 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:38:19 user nova-compute[72954]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1261661191</nova:name>
Sep 04 23:38:19 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:38:18</nova:creationTime>
Sep 04 23:38:19 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:38:19 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:38:19 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:38:19 user nova-compute[72954]:       <nova:owner>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:user uuid="9d9225a248e74846a14e23c39b73af40">tempest-ServerActionsV293TestJSON-1401063680-project-member</nova:user>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:project uuid="01f8d72425c1459c92ad272dcae828a5">tempest-ServerActionsV293TestJSON-1401063680</nova:project>
Sep 04 23:38:19 user nova-compute[72954]:       </nova:owner>
Sep 04 23:38:19 user nova-compute[72954]:       <nova:ports>
Sep 04 23:38:19 user nova-compute[72954]:         <nova:port uuid="a1df8d1c-86a8-4f87-a770-5365dd719443">
Sep 04 23:38:19 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Sep 04 23:38:19 user nova-compute[72954]:         </nova:port>
Sep 04 23:38:19 user nova-compute[72954]:       </nova:ports>
Sep 04 23:38:19 user nova-compute[72954]:     </nova:instance>
Sep 04 23:38:19 user nova-compute[72954]:   </metadata>
Sep 04 23:38:19 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:38:19 user nova-compute[72954]:     <system>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="serial">82e7603c-406f-407f-8893-453c44ebd868</entry>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="uuid">82e7603c-406f-407f-8893-453c44ebd868</entry>
Sep 04 23:38:19 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:38:19 user nova-compute[72954]:     </system>
Sep 04 23:38:19 user nova-compute[72954]:   </sysinfo>
Sep 04 23:38:19 user nova-compute[72954]:   <os>
Sep 04 23:38:19 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:38:19 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:38:19 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:38:19 user nova-compute[72954]:   </os>
Sep 04 23:38:19 user nova-compute[72954]:   <features>
Sep 04 23:38:19 user nova-compute[72954]:     <acpi/>
Sep 04 23:38:19 user nova-compute[72954]:     <apic/>
Sep 04 23:38:19 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:38:19 user nova-compute[72954]:   </features>
Sep 04 23:38:19 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:38:19 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:38:19 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:38:19 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:38:19 user nova-compute[72954]:   </clock>
Sep 04 23:38:19 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:38:19 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:38:19 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:38:19 user nova-compute[72954]:   </cpu>
Sep 04 23:38:19 user nova-compute[72954]:   <devices>
Sep 04 23:38:19 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:38:19 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:38:19 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 04 23:38:19 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:38:19 user nova-compute[72954]:       <serial>2db09f32-5798-4b04-bda8-f9b151a9e3ad</serial>
Sep 04 23:38:19 user nova-compute[72954]:     </disk>
Sep 04 23:38:19 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:38:19 user nova-compute[72954]:       <mac address="fa:16:3e:9e:30:71"/>
Sep 04 23:38:19 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:38:19 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:38:19 user nova-compute[72954]:       <target dev="tapa1df8d1c-86"/>
Sep 04 23:38:19 user nova-compute[72954]:     </interface>
Sep 04 23:38:19 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:38:19 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868/console.log" append="off"/>
Sep 04 23:38:19 user nova-compute[72954]:     </serial>
Sep 04 23:38:19 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:38:19 user nova-compute[72954]:     <video>
Sep 04 23:38:19 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:38:19 user nova-compute[72954]:     </video>
Sep 04 23:38:19 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:38:19 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:38:19 user nova-compute[72954]:     </rng>
Sep 04 23:38:19 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:38:19 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:38:19 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:38:19 user nova-compute[72954]:     </memballoon>
Sep 04 23:38:19 user nova-compute[72954]:   </devices>
Sep 04 23:38:19 user nova-compute[72954]: </domain>
Sep 04 23:38:19 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1261661191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG os_vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1df8d1c-86, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1df8d1c-86, col_values=(('external_ids', {'iface-id': 'a1df8d1c-86a8-4f87-a770-5365dd719443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:30:71', 'vm-uuid': '82e7603c-406f-407f-8893-453c44ebd868'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:19 user nova-compute[72954]: INFO os_vif [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86')
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:38:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] No VIF found with MAC fa:16:3e:9e:30:71, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:21 user nova-compute[72954]: WARNING nova.compute.manager [req-68887b5d-5058-4b6b-b736-58e42e5a99ed req-1bd14c39-95d8-4560-a1f6-e6eba8d159c9 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state active and task_state rebuild_spawning.
Sep 04 23:38:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:23 user nova-compute[72954]: WARNING nova.compute.manager [req-4731d5cd-437c-4328-a881-4ffe0ab1d90a req-8039222e-e894-4bf5-91bb-56eb91977100 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state active and task_state rebuild_spawning.
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870703.6393416, 82e7603c-406f-407f-8893-453c44ebd868 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Resumed (Lifecycle Event)
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance spawned successfully.
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:38:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870703.6408625, 82e7603c-406f-407f-8893-453c44ebd868 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Started (Lifecycle Event)
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:38:23 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG nova.objects.instance [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72954) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Sep 04 23:38:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be6439d6-a6c0-4699-ab42-b5e2e04a6825 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.116s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:36 user nova-compute[72954]: INFO nova.compute.manager [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Terminating instance
Sep 04 23:38:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-8d100737-1da1-426f-97b4-b5de23c15baf req-15056c24-30e3-41f6-8557-568b8891355d service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Instance destroyed successfully.
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lazy-loading 'resources' on Instance uuid 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594356000',display_name='tempest-VolumesActionsTest-instance-1594356000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594356000',id=22,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2e836f28ced4b95946bb6a42b02513d',ramdisk_id='',reservation_id='r-q6qx5dce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1805885765',owner_user_name='tempest-VolumesActionsTest-1805885765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:36:39Z,user_data=None,user_id='6e8428594834442899a2b76f7e52cc5c',uuid=3b82885a-9eb7-42f7-96d4-4ee9312ca8a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converting VIF {"id": "95a08a35-3690-4ec9-8632-27a09fea24e6", "address": "fa:16:3e:88:4b:c1", "network": {"id": "3ee1f2c2-2a18-4662-9fff-755ed60fa9da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1605048327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2e836f28ced4b95946bb6a42b02513d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a08a35-36", "ovs_interfaceid": "95a08a35-3690-4ec9-8632-27a09fea24e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG os_vif [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95a08a35-36, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: INFO os_vif [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4b:c1,bridge_name='br-int',has_traffic_filtering=True,id=95a08a35-3690-4ec9-8632-27a09fea24e6,network=Network(3ee1f2c2-2a18-4662-9fff-755ed60fa9da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a08a35-36')
Sep 04 23:38:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Deleting instance files /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4_del
Sep 04 23:38:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Deletion of /opt/stack/data/nova/instances/3b82885a-9eb7-42f7-96d4-4ee9312ca8a4_del complete
Sep 04 23:38:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:37 user nova-compute[72954]: INFO nova.compute.manager [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Took 0.97 seconds to destroy the instance on the hypervisor.
Sep 04 23:38:37 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:38:37 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:38:38 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Took 1.06 seconds to deallocate network for instance.
Sep 04 23:38:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-5405975e-9304-408b-8151-46bc73a8cb6c req-36e912ea-a812-4c59-bad8-9156e24a8090 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-deleted-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:38 user nova-compute[72954]: INFO nova.compute.manager [req-5405975e-9304-408b-8151-46bc73a8cb6c req-36e912ea-a812-4c59-bad8-9156e24a8090 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Neutron deleted interface 95a08a35-3690-4ec9-8632-27a09fea24e6; detaching it from the instance and deleting it from the info cache
Sep 04 23:38:38 user nova-compute[72954]: DEBUG nova.network.neutron [req-5405975e-9304-408b-8151-46bc73a8cb6c req-36e912ea-a812-4c59-bad8-9156e24a8090 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-5405975e-9304-408b-8151-46bc73a8cb6c req-36e912ea-a812-4c59-bad8-9156e24a8090 service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Detach interface failed, port_id=95a08a35-3690-4ec9-8632-27a09fea24e6, reason: Instance 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:39 user nova-compute[72954]: WARNING nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state deleted and task_state None.
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:39 user nova-compute[72954]: WARNING nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state deleted and task_state None.
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:39 user nova-compute[72954]: WARNING nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state deleted and task_state None.
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:39 user nova-compute[72954]: WARNING nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-unplugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state deleted and task_state None.
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Acquiring lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] No waiting events found dispatching network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:38:39 user nova-compute[72954]: WARNING nova.compute.manager [req-74d68080-5b28-4c91-9ac9-174dea36f9b1 req-f2638b74-af12-405b-ade0-3730d386eb8a service nova] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Received unexpected event network-vif-plugged-95a08a35-3690-4ec9-8632-27a09fea24e6 for instance with vm_state deleted and task_state None.
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:39 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Deleted allocations for instance 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4
Sep 04 23:38:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-07a4ec8a-245a-4f2c-a143-aaf02e2e74fd tempest-VolumesActionsTest-1805885765 tempest-VolumesActionsTest-1805885765-project-member] Lock "3b82885a-9eb7-42f7-96d4-4ee9312ca8a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:38:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:52 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870717.6256528, 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:38:52 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] VM Stopped (Lifecycle Event)
Sep 04 23:38:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b9694c7b-d1d0-4ca1-a881-75f9630b510b None None] [instance: 3b82885a-9eb7-42f7-96d4-4ee9312ca8a4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:38:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:38:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:02 user nova-compute[72954]: INFO nova.compute.manager [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Terminating instance
Sep 04 23:39:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-b05a45cf-75c1-4f5e-9c97-0a4f235eae64 req-b48e12cd-7632-4fa8-94e8-1ed9856fd014 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-unplugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Instance destroyed successfully.
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.objects.instance [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'resources' on Instance uuid 98b7e205-7840-4e98-9f69-2cf6e7142202 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1879543623',display_name='tempest-ServerActionsTestOtherA-server-417883954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1879543623',id=16,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgRi9XQVB9zF/Z02xwV7dfCW9l3eUsKCu5kFLmPajmL/apKeqMlzglemZ5awYYgA1SPQXycbygDeUtsCDdPYTNOWnZQmhOuCy7dOxGLrOaP28nsBivk0RTBKLp7aP9zlg==',key_name='tempest-keypair-1004549767',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-dd0wfmsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=98b7e205-7840-4e98-9f69-2cf6e7142202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "address": "fa:16:3e:17:e9:5d", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a6e5e0-58", "ovs_interfaceid": "49a6e5e0-5816-4f60-84fd-5e97b0f86faf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG os_vif [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a6e5e0-58, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:03 user nova-compute[72954]: INFO os_vif [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:e9:5d,bridge_name='br-int',has_traffic_filtering=True,id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a6e5e0-58')
Sep 04 23:39:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Deleting instance files /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202_del
Sep 04 23:39:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Deletion of /opt/stack/data/nova/instances/98b7e205-7840-4e98-9f69-2cf6e7142202_del complete
Sep 04 23:39:03 user nova-compute[72954]: INFO nova.compute.manager [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Took 0.85 seconds to destroy the instance on the hypervisor.
Sep 04 23:39:03 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:39:03 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-e633ed07-d817-49b3-9ca5-829ad8170519 req-9491b8f3-bad7-4893-859c-bbd118f21136 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-deleted-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:04 user nova-compute[72954]: INFO nova.compute.manager [req-e633ed07-d817-49b3-9ca5-829ad8170519 req-9491b8f3-bad7-4893-859c-bbd118f21136 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Neutron deleted interface 49a6e5e0-5816-4f60-84fd-5e97b0f86faf; detaching it from the instance and deleting it from the info cache
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.network.neutron [req-e633ed07-d817-49b3-9ca5-829ad8170519 req-9491b8f3-bad7-4893-859c-bbd118f21136 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:04 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Took 0.76 seconds to deallocate network for instance.
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-e633ed07-d817-49b3-9ca5-829ad8170519 req-9491b8f3-bad7-4893-859c-bbd118f21136 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Detach interface failed, port_id=49a6e5e0-5816-4f60-84fd-5e97b0f86faf, reason: Instance 98b7e205-7840-4e98-9f69-2cf6e7142202 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:39:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:04 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Deleted allocations for instance 98b7e205-7840-4e98-9f69-2cf6e7142202
Sep 04 23:39:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-60072dc0-939b-4725-a0be-27547912a929 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] Acquiring lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] Lock "98b7e205-7840-4e98-9f69-2cf6e7142202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] No waiting events found dispatching network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:05 user nova-compute[72954]: WARNING nova.compute.manager [req-8b2ac092-223a-4783-9b9b-171c53252d9f req-be5d092c-f60a-4d3b-8d45-55e5ec434dd3 service nova] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Received unexpected event network-vif-plugged-49a6e5e0-5816-4f60-84fd-5e97b0f86faf for instance with vm_state deleted and task_state None.
Sep 04 23:39:07 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:07 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'flavor' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:11 user nova-compute[72954]: INFO nova.compute.manager [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Attaching volume 484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 to /dev/vdb
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[531f802d-ef58-4e3f-a4b6-d4d78c10c0c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da35ebb-0c61-4f8f-aec1-3f29460cf441]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11281b8f-9a7f-48b2-861d-b1e0225f068f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21575e3-f15d-4fc6-9aad-1b090f49e09f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:11 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb93b039-9a73-4c74-9924-37ffd4a5a2f7]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating existing volume attachment record: 3fc6b037-b0ed-41f8-9c7d-f9329524e2f9 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:12 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:12 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7013MB free_disk=25.168739318847656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 07911333-3216-4cc3-839e-e29f1f561ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [{"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-b74564bb-948a-43be-81b7-8504f4dc023a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing instance network info cache due to event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updated VIF entry in instance network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-58d30749-3c8d-4a86-8d88-4baefd77aa08 req-28e005f4-836c-4e86-aa28-5641ce36faab service nova] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870743.5073872, 98b7e205-7840-4e98-9f69-2cf6e7142202 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:39:18 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] VM Stopped (Lifecycle Event)
Sep 04 23:39:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1239e1d8-c98c-46a9-8c9b-ca0c4c144b93 None None] [instance: 98b7e205-7840-4e98-9f69-2cf6e7142202] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing instance network info cache due to event network-changed-b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] Acquiring lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] Acquired lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Refreshing network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:19 user nova-compute[72954]: INFO nova.compute.manager [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Detaching volume d5ced50d-a4ff-4911-b758-5fb2468d1ffc
Sep 04 23:39:19 user nova-compute[72954]: INFO nova.virt.block_device [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Attempting to driver detach volume d5ced50d-a4ff-4911-b758-5fb2468d1ffc from mountpoint /dev/vdb
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Attempting to detach device vdb from instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:39:19 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:19 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:39:19 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:39:19 user nova-compute[72954]:   <serial>d5ced50d-a4ff-4911-b758-5fb2468d1ffc</serial>
Sep 04 23:39:19 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:39:19 user nova-compute[72954]: </disk>
Sep 04 23:39:19 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:39:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully detached device vdb from instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 from the persistent domain config.
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:39:19 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:19 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:39:19 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:39:19 user nova-compute[72954]:   <serial>d5ced50d-a4ff-4911-b758-5fb2468d1ffc</serial>
Sep 04 23:39:19 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:39:19 user nova-compute[72954]: </disk>
Sep 04 23:39:19 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updated VIF entry in instance network info cache for port b6672997-a4c1-4cf8-acd9-5835c782a958. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [{"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8d80618-4a31-4cfb-8932-82cc59a3ed2b req-05be5668-f43b-4c67-836b-e462913ae132 service nova] Releasing lock "refresh_cache-a5e51f60-795c-4344-ac17-c7b5b9d9ad97" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870759.975565, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:39:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully detached device vdb from instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 from the live domain config.
Sep 04 23:39:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkHrMLPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:19 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:39:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0385d-c40e-42d7-afa4-4cd5473be9db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca1b59-a1f7-4516-9943-8ad54ba795ab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:20 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118318550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e616a-8add-4fe9-966a-f0e05156a338]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1ae57-7bfe-4f27-be9c-48d20f10b6c0]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4c830-4a15-40bf-a0f2-dedaa50f0f87]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb360e6-d970-4797-9ed4-c8a9c329cb98]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f5955d-a5e9-4377-85b5-de89bd014144]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b9bda-1ebb-4039-9ae4-a460bad2eecd]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260]
Sep 04 23:39:20 user nova-compute[72954]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:20 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ced50d-a4ff-4911-b758-5fb2468d1ffc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2937a59-73a7-4957-8c77-d75c84510f84]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== disconnect_volume: return (301ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:39:21 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a52e71db-5a23-4b91-bdf0-2552cd1419b7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.775s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:26 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:26 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:26 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf8cab-dfef-4b6d-a3e1-6e74cd9dbd1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:39:26 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806ca29-7b74-4670-9207-143031cb6ff6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added
Sep 04 23:39:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa2e1b-97a2-495b-b3c0-b8ed05cfa60b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318106f-7abf-4c41-836e-04d8625e1673]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a32c8-8e11-42fe-a8f1-7fd0d3566f59]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cENTrKsX'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b13e47b-366e-43c8-a277-ae74031eab32]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[888790ff-81f5-43a2-8fdd-1cc6fd3db2af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:26 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:26 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:26 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:26 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e5b01-7fa9-4c23-951f-d3f28ba712c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:39:27 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12c1116-a51c-43c1-a392-0a26e207f345]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[335c7a87-01aa-4c77-857a-ddf9553ec21c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:27 user nova-compute[72954]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.306s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e28dc-fd4c-4e47-a1ab-4b72527e01db]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.338s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== connect_volume: return (2339ms) {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'flavor' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:39:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:28 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:39:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:39:28 user nova-compute[72954]:   <serial>484be8f7-cc1d-4d8f-a135-4f5f54a82fb6</serial>
Sep 04 23:39:28 user nova-compute[72954]: </disk>
Sep 04 23:39:28 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:39:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No VIF found with MAC fa:16:3e:c9:89:d0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:39:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-87398103-5a7f-4761-9781-338316b4e138 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.028s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Stashing vm_state: active {{(pid=72954) _prep_resize /opt/stack/nova/nova/compute/manager.py:5598}}
Sep 04 23:39:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:39:31 user nova-compute[72954]: INFO nova.compute.claims [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Claim successful on node user
Sep 04 23:39:31 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating resource usage from migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb
Sep 04 23:39:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.525s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:32 user nova-compute[72954]: INFO nova.compute.manager [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Migrating
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:32 user nova-compute[72954]: INFO nova.compute.rpcapi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Starting migrate_disk_and_power_off {{(pid=72954) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Sep 04 23:39:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:33 user nova-compute[72954]: WARNING nova.compute.manager [req-95db4f7c-36b1-4d8c-800b-221e920a50c1 req-92013bb2-d226-4f89-9ac3-1a63f99fa086 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state resize_migrating.
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance destroyed successfully.
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254899bf-9c, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:33 user nova-compute[72954]: INFO os_vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:39:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:33 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c4da33-a8d0-4b04-9337-6d8181e58b70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633134d-2a4f-408a-8c3e-bb239e3deefe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:33 user nova-compute[72954]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11834b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c1c21-7dfd-47c6-b02f-8a3e1c6f0ebc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2f856-b3ef-4c8f-b9f0-20595e62b4b9]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3d0d7a-e632-422c-ab36-473214cf6af1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c5cd8e-45b3-4e9f-b477-e3475def2346]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f4d622-3673-4b3b-8df3-5ff62993c465]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ef6f0-1ab8-4cc1-aabb-0244a7979cb1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:39:33 user nova-compute[72954]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afaf6a4-6619-4763-94e4-f117112d6b1c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== disconnect_volume: return (350ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_resize/disk /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "cp -r /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_resize/disk /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk" returned: 0 in 0.376s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_resize/disk.info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk.info {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "cp -r /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_resize/disk.info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk.info" returned: 0 in 0.038s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:35 user nova-compute[72954]: WARNING nova.compute.manager [req-6eab1712-0c4e-4dc8-bd70-37bdde2443fe req-7f9169b0-8314-43cf-b6f3-30612794af5c service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state resize_migrating.
Sep 04 23:39:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Port 254899bf-9c89-46ea-8390-fed26be7c8cb binding to destination host user is already ACTIVE {{(pid=72954) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'info_cache' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG os_brick.utils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c5b42-1449-42a2-a3f0-37ce6483d6f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386a5bf-527a-48ec-8fad-dc3f09ac3182]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b530c87-8c3b-410e-91b4-5dd446dbf021]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e22d1-ade0-49ed-a2ea-8979da70a1af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:37 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed6ddeb-9635-44ac-a1d9-ee452127bbe3]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.utils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing instance network info cache due to event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance destroyed successfully.
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'resources' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ca716a-b3, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:37 user nova-compute[72954]: INFO os_vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:37 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[af452ff4-1bf9-42b0-ad5a-8e48f56f025b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'flavor' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:37 user nova-compute[72954]: INFO nova.compute.manager [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] instance snapshotting
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5e07c-cab6-48de-aeff-5d921c0fa9ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:37 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:37 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:37 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:37 user nova-compute[72954]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:37 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:37 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118348940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a77833-9f9f-430c-9a94-b99a25060572]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e1d1f8-7d7b-4a45-a05f-04344dd59275]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Beginning live snapshot process
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6997c3c0-34d9-4808-989e-f3d967de297f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1563a-8159-49c1-8a3c-17f895ffcf63]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d2aa4-cbaa-44bc-924e-7edd272d5bbd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ce17a-319c-4da3-9304-d88000a14595]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]
Sep 04 23:39:37 user nova-compute[72954]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:37 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:37 user nova-compute[72954]: INFO nova.compute.manager [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Attaching volume a3a5a17a-c812-4c8b-97b8-4744975c5fff to /dev/vdb
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updated VIF entry in instance network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9167a4-fc69-4f70-aeb5-efdc1ec5f9a7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== disconnect_volume: return (350ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start _get_guest_xml network_info=[{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '44a2a895-06fc-43e9-baab-0d30a22bce90', 'attached_at': '', 'detached_at': '', 'volume_id': '6c53c357-0db3-4331-baf4-28fb29394f95', 'serial': '6c53c357-0db3-4331-baf4-28fb29394f95'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '60b3b976-f30f-488a-8922-96076c429def', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'numa_topology' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1bb341ff-606b-4458-bf64-9cc0b387753e req-c3f78226-a6fe-44a2-942c-ceb73f3dc5ae service nova] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.utils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:38 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:38 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:38 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78ce6e-f7db-4435-bc00-4d6c37187444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec3102a-8b0c-4e69-91b9-975f62322533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:39:38 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b5668-1d9e-4515-a572-d2ed41854789]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b6488-0586-4764-a642-30004c7eb8cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e67369-83d1-4ef1-aa20-6039d1af7709]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95] added
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b1539-31c3-474e-affc-0ff190149a29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e5441-81a3-4399-b0db-781b2d7ce329]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:39:38 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7ae791-4051-49e3-973e-3c36a1851776]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6e733-6d53-4016-a2ba-d7a7c9a1ba37]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.utils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] <== get_connector_properties: return (234ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating existing volume attachment record: 07dc61ce-8660-4c6a-924a-bac58a2bce85 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkuUtgfp {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkuUtgfp" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7b89e-cced-4ea1-8f9a-d2b3b066de33]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jkuUtgfp'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19ff56-5dd9-4a64-9c48-84bbcdf3e973]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48de799-9053-4ed5-b456-a89ccbb33360]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c70826-8edb-4535-ba5c-7662396c9ad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]
Sep 04 23:39:38 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e521f-418f-41d2-bf5d-e91cd62c4b63]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c09313-30d0-4d0b-b491-2917feb44d11]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:38 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:38 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[05161329-6734-4dbd-b73f-cc6c00380580]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3.delta 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3.delta 1073741824" returned: 0 in 0.053s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Quiescing instance not available: QEMU guest agent is not enabled.
Sep 04 23:39:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26630633366663762', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633366663762', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'pci_devices' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:39:39 user nova-compute[72954]:   <uuid>44a2a895-06fc-43e9-baab-0d30a22bce90</uuid>
Sep 04 23:39:39 user nova-compute[72954]:   <name>instance-00000015</name>
Sep 04 23:39:39 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:39:39 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:39:39 user nova-compute[72954]:   <metadata>
Sep 04 23:39:39 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:39:39 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeTestJSON-server-2106306957</nova:name>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:39:37</nova:creationTime>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:39:39 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:39:39 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:owner>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:user uuid="d2c3ec932cc64d98a8b1b6c10dd6f432">tempest-AttachVolumeTestJSON-79448822-project-member</nova:user>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:project uuid="9857524a888d4d9f9d3e48341500411a">tempest-AttachVolumeTestJSON-79448822</nova:project>
Sep 04 23:39:39 user nova-compute[72954]:       </nova:owner>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:39:39 user nova-compute[72954]:       <nova:ports>
Sep 04 23:39:39 user nova-compute[72954]:         <nova:port uuid="28ca716a-b39a-4923-8261-36a8a99899cf">
Sep 04 23:39:39 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Sep 04 23:39:39 user nova-compute[72954]:         </nova:port>
Sep 04 23:39:39 user nova-compute[72954]:       </nova:ports>
Sep 04 23:39:39 user nova-compute[72954]:     </nova:instance>
Sep 04 23:39:39 user nova-compute[72954]:   </metadata>
Sep 04 23:39:39 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:39:39 user nova-compute[72954]:     <system>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="serial">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="uuid">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:39:39 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:39:39 user nova-compute[72954]:     </system>
Sep 04 23:39:39 user nova-compute[72954]:   </sysinfo>
Sep 04 23:39:39 user nova-compute[72954]:   <os>
Sep 04 23:39:39 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:39:39 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:39:39 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:39:39 user nova-compute[72954]:   </os>
Sep 04 23:39:39 user nova-compute[72954]:   <features>
Sep 04 23:39:39 user nova-compute[72954]:     <acpi/>
Sep 04 23:39:39 user nova-compute[72954]:     <apic/>
Sep 04 23:39:39 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:39:39 user nova-compute[72954]:   </features>
Sep 04 23:39:39 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:39:39 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:39:39 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:39:39 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:39:39 user nova-compute[72954]:   </clock>
Sep 04 23:39:39 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:39:39 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:39:39 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:39:39 user nova-compute[72954]:   </cpu>
Sep 04 23:39:39 user nova-compute[72954]:   <devices>
Sep 04 23:39:39 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:39:39 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:39:39 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk"/>
Sep 04 23:39:39 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:39:39 user nova-compute[72954]:     </disk>
Sep 04 23:39:39 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:39:39 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:39 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:39:39 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:39:39 user nova-compute[72954]:       <serial>6c53c357-0db3-4331-baf4-28fb29394f95</serial>
Sep 04 23:39:39 user nova-compute[72954]:     </disk>
Sep 04 23:39:39 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:39:39 user nova-compute[72954]:       <mac address="fa:16:3e:d0:ea:8a"/>
Sep 04 23:39:39 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:39:39 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:39:39 user nova-compute[72954]:       <target dev="tap28ca716a-b3"/>
Sep 04 23:39:39 user nova-compute[72954]:     </interface>
Sep 04 23:39:39 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:39:39 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/console.log" append="off"/>
Sep 04 23:39:39 user nova-compute[72954]:     </serial>
Sep 04 23:39:39 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:39:39 user nova-compute[72954]:     <video>
Sep 04 23:39:39 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:39:39 user nova-compute[72954]:     </video>
Sep 04 23:39:39 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:39:39 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:39:39 user nova-compute[72954]:     </rng>
Sep 04 23:39:39 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:39:39 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:39:39 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:39:39 user nova-compute[72954]:     </memballoon>
Sep 04 23:39:39 user nova-compute[72954]:   </devices>
Sep 04 23:39:39 user nova-compute[72954]: </domain>
Sep 04 23:39:39 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] COPY block job progress, current cursor: 2883584 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:39:40 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Skipping quiescing instance: QEMU guest agent is not enabled.
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3.delta /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Cannot resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'migration_context' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.objects.base [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG os_vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ca716a-b3, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28ca716a-b3, col_values=(('external_ids', {'iface-id': '28ca716a-b39a-4923-8261-36a8a99899cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ea:8a', 'vm-uuid': '44a2a895-06fc-43e9-baab-0d30a22bce90'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:40 user nova-compute[72954]: INFO os_vif [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:39:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3.delta /opt/stack/data/nova/instances/snapshots/tmp4owvrzql/5904b07d3eb24a6aa06eb83261f3d2c3" returned: 0 in 0.396s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:40 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Snapshot extracted, beginning image upload
Sep 04 23:39:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:42 user nova-compute[72954]: WARNING nova.compute.manager [req-6e7d3b0f-594a-488e-8a50-eb9802de5976 req-40f2f879-eb93-4bcf-a2b1-500d230b4636 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state powering-on.
Sep 04 23:39:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Snapshot image upload complete
Sep 04 23:39:43 user nova-compute[72954]: INFO nova.compute.manager [None req-6e2ca0c6-1124-4458-bf09-0fa88e13a24b tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Took 6.34 seconds to snapshot the instance on the hypervisor.
Sep 04 23:39:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:44 user nova-compute[72954]: WARNING nova.compute.manager [req-2d5264f0-e7dd-4756-bf7c-e44ab3c55176 req-b9b2fd6e-0af2-4105-bcc2-d48dd983c093 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state powering-on.
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870785.0028148, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:39:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Resumed (Lifecycle Event)
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:39:45 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance rebooted successfully.
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f914d73-383f-4310-adf8-144a939f6355 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:39:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] During sync_power_state the instance has a pending task (powering-on). Skip.
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870785.0076008, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:39:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Started (Lifecycle Event)
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:39:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:48 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870773.6356714, 663bbb50-2a1f-426a-92ba-6e925db7824f => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:39:48 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Stopped (Lifecycle Event)
Sep 04 23:39:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b4d03643-2cd7-4cf5-9a89-045a6fece9d8 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:39:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b4d03643-2cd7-4cf5-9a89-045a6fece9d8 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:39:48 user nova-compute[72954]: INFO nova.compute.manager [None req-b4d03643-2cd7-4cf5-9a89-045a6fece9d8 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:39:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Starting finish_migration {{(pid=72954) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:39:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Creating image(s)
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk. size=21474836480 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk 21474836480 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk 21474836480" returned: 0 in 0.055s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Ensure instance console log exists: /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start _get_guest_xml network_info=[{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '663bbb50-2a1f-426a-92ba-6e925db7824f', 'attached_at': '2023-09-04T23:39:55.000000', 'detached_at': '', 'volume_id': '484be8f7-cc1d-4d8f-a135-4f5f54a82fb6', 'serial': '484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '15931105-eb49-4d2b-85e9-a19dd4122137', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:39:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:55 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b72eb3-a696-4cad-a22c-2746e4ee9ffa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:39:55 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d8354-83da-40cf-b6c7-e5209050d6e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added
Sep 04 23:39:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac4cbc-bef4-4af4-b492-aa8e0d45f7ed]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dbea98-0fde-43e1-8f09-e371c0dda6bf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b2755-372a-4233-9b43-b7d3b1a3d012]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cENTrKsX'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc57b0-c07c-49c0-9a3d-51d090a606c6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb46d3-454c-4ccd-ac28-bde2d83d1c9c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:55 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:55 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:55 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:55 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f0856-7970-4e90-ba0e-89c91ad5e4e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:39:55 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e378894-26ab-444a-b8f0-dbae0d50ffe2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4344e-02de-4194-b110-1b0296742f2a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:56 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:56 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:56 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1398e4-5ad1-475c-aafe-07653b8ecd55]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihsFMHyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:39:56 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.451s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:39:57 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa89c6-d9c5-4805-a1b8-5457fbd74f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:39:57 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:39:57 user nova-compute[72954]:   <uuid>663bbb50-2a1f-426a-92ba-6e925db7824f</uuid>
Sep 04 23:39:57 user nova-compute[72954]:   <name>instance-00000014</name>
Sep 04 23:39:57 user nova-compute[72954]:   <memory>2097152</memory>
Sep 04 23:39:57 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:39:57 user nova-compute[72954]:   <metadata>
Sep 04 23:39:57 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:39:57 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752440406</nova:name>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:39:55</nova:creationTime>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:flavor name="m1.small">
Sep 04 23:39:57 user nova-compute[72954]:         <nova:memory>2048</nova:memory>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:disk>20</nova:disk>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:39:57 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:owner>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:user uuid="1ecac73ee2f44251a327642041bbd1b3">tempest-ServerActionsTestOtherB-1198156614-project-member</nova:user>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:project uuid="39f3ce2c11044ffd860d87380f4cca0b">tempest-ServerActionsTestOtherB-1198156614</nova:project>
Sep 04 23:39:57 user nova-compute[72954]:       </nova:owner>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:39:57 user nova-compute[72954]:       <nova:ports>
Sep 04 23:39:57 user nova-compute[72954]:         <nova:port uuid="254899bf-9c89-46ea-8390-fed26be7c8cb">
Sep 04 23:39:57 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 04 23:39:57 user nova-compute[72954]:         </nova:port>
Sep 04 23:39:57 user nova-compute[72954]:       </nova:ports>
Sep 04 23:39:57 user nova-compute[72954]:     </nova:instance>
Sep 04 23:39:57 user nova-compute[72954]:   </metadata>
Sep 04 23:39:57 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:39:57 user nova-compute[72954]:     <system>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="serial">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="uuid">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:39:57 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:39:57 user nova-compute[72954]:     </system>
Sep 04 23:39:57 user nova-compute[72954]:   </sysinfo>
Sep 04 23:39:57 user nova-compute[72954]:   <os>
Sep 04 23:39:57 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:39:57 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:39:57 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:39:57 user nova-compute[72954]:   </os>
Sep 04 23:39:57 user nova-compute[72954]:   <features>
Sep 04 23:39:57 user nova-compute[72954]:     <acpi/>
Sep 04 23:39:57 user nova-compute[72954]:     <apic/>
Sep 04 23:39:57 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:39:57 user nova-compute[72954]:   </features>
Sep 04 23:39:57 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:39:57 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:39:57 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:39:57 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:39:57 user nova-compute[72954]:   </clock>
Sep 04 23:39:57 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:39:57 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:39:57 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:39:57 user nova-compute[72954]:   </cpu>
Sep 04 23:39:57 user nova-compute[72954]:   <devices>
Sep 04 23:39:57 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:39:57 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:39:57 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk"/>
Sep 04 23:39:57 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:39:57 user nova-compute[72954]:     </disk>
Sep 04 23:39:57 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:39:57 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:57 user nova-compute[72954]:       <source dev="/dev/sdd"/>
Sep 04 23:39:57 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:39:57 user nova-compute[72954]:       <serial>484be8f7-cc1d-4d8f-a135-4f5f54a82fb6</serial>
Sep 04 23:39:57 user nova-compute[72954]:     </disk>
Sep 04 23:39:57 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:39:57 user nova-compute[72954]:       <mac address="fa:16:3e:c9:89:d0"/>
Sep 04 23:39:57 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:39:57 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:39:57 user nova-compute[72954]:       <target dev="tap254899bf-9c"/>
Sep 04 23:39:57 user nova-compute[72954]:     </interface>
Sep 04 23:39:57 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:39:57 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/console.log" append="off"/>
Sep 04 23:39:57 user nova-compute[72954]:     </serial>
Sep 04 23:39:57 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:39:57 user nova-compute[72954]:     <video>
Sep 04 23:39:57 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:39:57 user nova-compute[72954]:     </video>
Sep 04 23:39:57 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:39:57 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:39:57 user nova-compute[72954]:     </rng>
Sep 04 23:39:57 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:39:57 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:39:57 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:39:57 user nova-compute[72954]:     </memballoon>
Sep 04 23:39:57 user nova-compute[72954]:   </devices>
Sep 04 23:39:57 user nova-compute[72954]: </domain>
Sep 04 23:39:57 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-559017708-network", "vif_mac": "fa:16:3e:c9:89:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a007e6-1a37-409c-9661-3ce365cf54ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff] added
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254899bf-9c, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254899bf-9c, col_values=(('external_ids', {'iface-id': '254899bf-9c89-46ea-8390-fed26be7c8cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:89:d0', 'vm-uuid': '663bbb50-2a1f-426a-92ba-6e925db7824f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:57 user nova-compute[72954]: INFO os_vif [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9214cb0e-0376-424d-9bcd-1ac8e806aa6d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[30520eb4-0cf0-498e-bffc-153c0ab40cce]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihsFMHyA {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihsFMHyA" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb46fb-115f-436b-8680-4f970ca5ac0f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihsFMHyA'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72765c0-e80b-440d-88bf-592b38089f26]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] No VIF found with MAC fa:16:3e:c9:89:d0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058e5c3-1a88-4079-a3b4-6c700dc173e2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a406176-75b7-415f-8fc0-7661414a31b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260]
Sep 04 23:39:57 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260] successful.
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee197ec1-57d7-4af3-82cc-6e0577a17a6d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e72042-9c4f-402c-9df3-aef7e0fff7b3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:39:57 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:39:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7f6c3-26d1-4853-b16a-ae8d9fc86fd3]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:39:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihsFMHyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] <== connect_volume: return (1867ms) {'type': 'block', 'scsi_wwn': '26438363564643863', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438363564643863', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG nova.objects.instance [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'flavor' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:39:58 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:39:58 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:39:58 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:39:58 user nova-compute[72954]:   <serial>a3a5a17a-c812-4c8b-97b8-4744975c5fff</serial>
Sep 04 23:39:58 user nova-compute[72954]: </disk>
Sep 04 23:39:58 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:39:59 user nova-compute[72954]: WARNING nova.compute.manager [req-efaa7808-1ec3-477f-adff-61bd99174992 req-cea5a498-a950-4ca8-924d-90375cc2aad4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state resize_finish.
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:ee:c4:e6, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f789f4c2-7cde-4e18-8fdc-e54ecb53f56f tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.658s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:39:59 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:39:59 user nova-compute[72954]: INFO nova.compute.claims [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Claim successful on node user
Sep 04 23:40:00 user nova-compute[72954]: INFO nova.compute.manager [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Rescuing
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.network.neutron [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:40:00 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.policy [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e70c64a167d478a82d96dce40a11a8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dec2432d9404b94f2f5f16ab0c193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:40:00 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Creating image(s)
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "/opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "/opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:01 user nova-compute[72954]: WARNING nova.compute.manager [req-f12ceaf2-30d8-4956-81eb-5afd2779b38a req-7bd74fe0-5863-4835-ae32-41e759caba25 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state resize_finish.
Sep 04 23:40:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.223s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk 1073741824" returned: 0 in 0.065s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Successfully created port: 59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.252s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870801.7345319, 663bbb50-2a1f-426a-92ba-6e925db7824f => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Resumed (Lifecycle Event)
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance running successfully.
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Failed to set time: agent not configured {{(pid=72954) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6318d9d7-9bf1-4e71-ae38-f0081492ae70 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] finish_migration finished successfully. {{(pid=72954) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870801.735547, 663bbb50-2a1f-426a-92ba-6e925db7824f => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Started (Lifecycle Event)
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Cannot resize image /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Ensure instance console log exists: /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance destroyed successfully.
Sep 04 23:40:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Attempting rescue
Sep 04 23:40:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72954) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:40:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Creating image(s)
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'trusted_certs' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue" returned: 0 in 0.049s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'migration_context' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.base [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c88b8e02-ab4d-4c55-8e32-d61e8674121c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start _get_guest_xml network_info=[{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:ee:c4:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.base [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c88b8e02-ab4d-4c55-8e32-d61e8674121c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'numa_topology' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.base [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c88b8e02-ab4d-4c55-8e32-d61e8674121c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:40:02 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:02 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'vcpu_model' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.base [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c88b8e02-ab4d-4c55-8e32-d61e8674121c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436359465',display_name='tempest-ServerRescueNegativeTestJSON-server-436359465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436359465',id=24,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU+3donveUiSkzIO5j0s3zuZeAeSf15n6hkRBW8qYDZ7MYb7k62h8LVfhyHdlafg0Ham4nmkKJCW8CSTZ4st9cFiWSwUhfRffy/8YBP6NH3TgSXUYxLDtRcUEpq1ShrdQ==',key_name='tempest-keypair-1968450403',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:37:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-mm7pnk05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:37:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c88b8e02-ab4d-4c55-8e32-d61e8674121c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:ee:c4:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "vif_mac": "fa:16:3e:ee:c4:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'pci_devices' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Successfully updated port: 59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.base [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Object Instance<c88b8e02-ab4d-4c55-8e32-d61e8674121c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:40:02 user nova-compute[72954]:   <uuid>c88b8e02-ab4d-4c55-8e32-d61e8674121c</uuid>
Sep 04 23:40:02 user nova-compute[72954]:   <name>instance-00000018</name>
Sep 04 23:40:02 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:40:02 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:40:02 user nova-compute[72954]:   <metadata>
Sep 04 23:40:02 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:40:02 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-436359465</nova:name>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:40:02</nova:creationTime>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:40:02 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:owner>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:user uuid="84a77f46b55f4de2aac8145636dda0b5">tempest-ServerRescueNegativeTestJSON-1542679090-project-member</nova:user>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:project uuid="df8caf44b9944100837bfc22addb20d7">tempest-ServerRescueNegativeTestJSON-1542679090</nova:project>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:owner>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:ports>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:port uuid="b2eaacb4-91c4-4585-927e-80930137fe18">
Sep 04 23:40:02 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 04 23:40:02 user nova-compute[72954]:         </nova:port>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:ports>
Sep 04 23:40:02 user nova-compute[72954]:     </nova:instance>
Sep 04 23:40:02 user nova-compute[72954]:   </metadata>
Sep 04 23:40:02 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:40:02 user nova-compute[72954]:     <system>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="serial">c88b8e02-ab4d-4c55-8e32-d61e8674121c</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="uuid">c88b8e02-ab4d-4c55-8e32-d61e8674121c</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:40:02 user nova-compute[72954]:     </system>
Sep 04 23:40:02 user nova-compute[72954]:   </sysinfo>
Sep 04 23:40:02 user nova-compute[72954]:   <os>
Sep 04 23:40:02 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:40:02 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:40:02 user nova-compute[72954]:   </os>
Sep 04 23:40:02 user nova-compute[72954]:   <features>
Sep 04 23:40:02 user nova-compute[72954]:     <acpi/>
Sep 04 23:40:02 user nova-compute[72954]:     <apic/>
Sep 04 23:40:02 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:40:02 user nova-compute[72954]:   </features>
Sep 04 23:40:02 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:40:02 user nova-compute[72954]:   </clock>
Sep 04 23:40:02 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:40:02 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:40:02 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:40:02 user nova-compute[72954]:   </cpu>
Sep 04 23:40:02 user nova-compute[72954]:   <devices>
Sep 04 23:40:02 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:40:02 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:40:02 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue"/>
Sep 04 23:40:02 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:     </disk>
Sep 04 23:40:02 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:40:02 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:40:02 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk"/>
Sep 04 23:40:02 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:     </disk>
Sep 04 23:40:02 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:40:02 user nova-compute[72954]:       <mac address="fa:16:3e:ee:c4:e6"/>
Sep 04 23:40:02 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:40:02 user nova-compute[72954]:       <target dev="tapb2eaacb4-91"/>
Sep 04 23:40:02 user nova-compute[72954]:     </interface>
Sep 04 23:40:02 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:40:02 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/console.log" append="off"/>
Sep 04 23:40:02 user nova-compute[72954]:     </serial>
Sep 04 23:40:02 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:40:02 user nova-compute[72954]:     <video>
Sep 04 23:40:02 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:     </video>
Sep 04 23:40:02 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:40:02 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:40:02 user nova-compute[72954]:     </rng>
Sep 04 23:40:02 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:40:02 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:40:02 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:40:02 user nova-compute[72954]:     </memballoon>
Sep 04 23:40:02 user nova-compute[72954]:   </devices>
Sep 04 23:40:02 user nova-compute[72954]: </domain>
Sep 04 23:40:02 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquired lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-changed-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Refreshing instance network info cache due to event network-changed-59205384-bd4c-4b4e-95a7-753c5298416e. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] Acquiring lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance destroyed successfully.
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] No VIF found with MAC fa:16:3e:ee:c4:e6, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Updating instance_info_cache with network_info: [{"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Releasing lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Instance network_info: |[{"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] Acquired lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.neutron [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Refreshing network info cache for port 59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Start _get_guest_xml network_info=[{"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:40:02 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:02 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-498704995',display_name='tempest-ServersNegativeTestJSON-server-498704995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-498704995',id=26,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-ocbabixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:40:01Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=a6a888d0-99cd-4c1d-afca-e6f88402739b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lazy-loading 'pci_devices' on Instance uuid a6a888d0-99cd-4c1d-afca-e6f88402739b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:40:02 user nova-compute[72954]:   <uuid>a6a888d0-99cd-4c1d-afca-e6f88402739b</uuid>
Sep 04 23:40:02 user nova-compute[72954]:   <name>instance-0000001a</name>
Sep 04 23:40:02 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:40:02 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:40:02 user nova-compute[72954]:   <metadata>
Sep 04 23:40:02 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:40:02 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:name>tempest-ServersNegativeTestJSON-server-498704995</nova:name>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:40:02</nova:creationTime>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:40:02 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:owner>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:user uuid="8e70c64a167d478a82d96dce40a11a8e">tempest-ServersNegativeTestJSON-817858437-project-member</nova:user>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:project uuid="537dec2432d9404b94f2f5f16ab0c193">tempest-ServersNegativeTestJSON-817858437</nova:project>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:owner>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:40:02 user nova-compute[72954]:       <nova:ports>
Sep 04 23:40:02 user nova-compute[72954]:         <nova:port uuid="59205384-bd4c-4b4e-95a7-753c5298416e">
Sep 04 23:40:02 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Sep 04 23:40:02 user nova-compute[72954]:         </nova:port>
Sep 04 23:40:02 user nova-compute[72954]:       </nova:ports>
Sep 04 23:40:02 user nova-compute[72954]:     </nova:instance>
Sep 04 23:40:02 user nova-compute[72954]:   </metadata>
Sep 04 23:40:02 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:40:02 user nova-compute[72954]:     <system>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="serial">a6a888d0-99cd-4c1d-afca-e6f88402739b</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="uuid">a6a888d0-99cd-4c1d-afca-e6f88402739b</entry>
Sep 04 23:40:02 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:40:02 user nova-compute[72954]:     </system>
Sep 04 23:40:02 user nova-compute[72954]:   </sysinfo>
Sep 04 23:40:02 user nova-compute[72954]:   <os>
Sep 04 23:40:02 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:40:02 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:40:02 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:40:02 user nova-compute[72954]:   </os>
Sep 04 23:40:02 user nova-compute[72954]:   <features>
Sep 04 23:40:02 user nova-compute[72954]:     <acpi/>
Sep 04 23:40:02 user nova-compute[72954]:     <apic/>
Sep 04 23:40:02 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:40:02 user nova-compute[72954]:   </features>
Sep 04 23:40:02 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:40:02 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:40:02 user nova-compute[72954]:   </clock>
Sep 04 23:40:02 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:40:02 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:40:02 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:40:02 user nova-compute[72954]:   </cpu>
Sep 04 23:40:02 user nova-compute[72954]:   <devices>
Sep 04 23:40:02 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:40:02 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:40:02 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk"/>
Sep 04 23:40:02 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:     </disk>
Sep 04 23:40:02 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:40:02 user nova-compute[72954]:       <mac address="fa:16:3e:f1:70:3f"/>
Sep 04 23:40:02 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:40:02 user nova-compute[72954]:       <target dev="tap59205384-bd"/>
Sep 04 23:40:02 user nova-compute[72954]:     </interface>
Sep 04 23:40:02 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:40:02 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/console.log" append="off"/>
Sep 04 23:40:02 user nova-compute[72954]:     </serial>
Sep 04 23:40:02 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:40:02 user nova-compute[72954]:     <video>
Sep 04 23:40:02 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:02 user nova-compute[72954]:     </video>
Sep 04 23:40:02 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:40:02 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:40:02 user nova-compute[72954]:     </rng>
Sep 04 23:40:02 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:40:02 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:40:02 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:40:02 user nova-compute[72954]:     </memballoon>
Sep 04 23:40:02 user nova-compute[72954]:   </devices>
Sep 04 23:40:02 user nova-compute[72954]: </domain>
Sep 04 23:40:02 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-498704995',display_name='tempest-ServersNegativeTestJSON-server-498704995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-498704995',id=26,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-ocbabixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:40:01Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=a6a888d0-99cd-4c1d-afca-e6f88402739b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG os_vif [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59205384-bd, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59205384-bd, col_values=(('external_ids', {'iface-id': '59205384-bd4c-4b4e-95a7-753c5298416e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:70:3f', 'vm-uuid': 'a6a888d0-99cd-4c1d-afca-e6f88402739b'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:40:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:02 user nova-compute[72954]: INFO os_vif [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd')
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] No VIF found with MAC fa:16:3e:f1:70:3f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:03 user nova-compute[72954]: WARNING nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state active and task_state rescuing.
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:03 user nova-compute[72954]: WARNING nova.compute.manager [req-7e4ca5c4-b380-47c1-a42d-8364c02855e1 req-10d6c5ff-cc3e-4f66-8256-422c13c9ce25 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state active and task_state rescuing.
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Updated VIF entry in instance network info cache for port 59205384-bd4c-4b4e-95a7-753c5298416e. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG nova.network.neutron [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Updating instance_info_cache with network_info: [{"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-deef32e6-d1c7-4f90-abd0-1eee4b16c760 req-199c9254-e55a-47ab-9dd7-2b858648ad92 service nova] Releasing lock "refresh_cache-a6a888d0-99cd-4c1d-afca-e6f88402739b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:40:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:05 user nova-compute[72954]: WARNING nova.compute.manager [req-ee29532e-645a-42ea-80b0-6216c1a16dcb req-fcb0a66d-6926-4229-9e40-b46ca71e68a0 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state active and task_state rescuing.
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] No waiting events found dispatching network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:05 user nova-compute[72954]: WARNING nova.compute.manager [req-53396392-81cd-49bd-88fe-4dcd9170a748 req-7dc1abed-5a00-423a-8196-dc0046261444 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received unexpected event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e for instance with vm_state building and task_state spawning.
Sep 04 23:40:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:07 user nova-compute[72954]: WARNING nova.compute.manager [req-b3d8bc54-968c-4b73-9846-53454c1cc46d req-4063ee21-0a8e-4a1b-8b30-d31408d4dac5 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state active and task_state rescuing.
Sep 04 23:40:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] No waiting events found dispatching network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:07 user nova-compute[72954]: WARNING nova.compute.manager [req-ad12673b-e5bf-4c36-b561-3931c4adc9c2 req-e0366390-8465-4de4-9934-dd730e19e79f service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received unexpected event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e for instance with vm_state building and task_state spawning.
Sep 04 23:40:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870808.3076794, a6a888d0-99cd-4c1d-afca-e6f88402739b => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] VM Resumed (Lifecycle Event)
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Instance spawned successfully.
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870808.3118083, a6a888d0-99cd-4c1d-afca-e6f88402739b => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] VM Started (Lifecycle Event)
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-56a1f4d6-8567-4f07-a99a-61762b5de2e2 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for c88b8e02-ab4d-4c55-8e32-d61e8674121c due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870808.38929, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Resumed (Lifecycle Event)
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Took 7.66 seconds to spawn the instance on the hypervisor.
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870808.389749, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Started (Lifecycle Event)
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:08 user nova-compute[72954]: INFO nova.compute.manager [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Took 8.91 seconds to build instance.
Sep 04 23:40:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0f78bce8-9b21-44ae-a1f5-dc7ae84e2b96 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.051s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:09 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:40:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:40:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.280s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:15 user nova-compute[72954]: INFO nova.compute.manager [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Terminating instance
Sep 04 23:40:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-effec34f-cbe4-4d38-86a7-655b9d953c60 req-ddd04639-904d-4eb9-8ef6-98198cb30439 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-unplugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Instance destroyed successfully.
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lazy-loading 'resources' on Instance uuid 82e7603c-406f-407f-8893-453c44ebd868 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1261661191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-443982407',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwVFdxzwDLlnVRaAR785ovM1yBpoIqqubIai/KIaQSQmBikQMyP3QebbIh3UND1D8RGAVP3B7zdNPA6ARNUJ0QSov4wdUqeU3c1iiefJu+WmwfqhwOFeHaWnp/nO1zERw==',key_name='tempest-keypair-1073491531',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01f8d72425c1459c92ad272dcae828a5',ramdisk_id='',reservation_id='r-4l48crri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1401063680',owner_user_name='tempest-ServerActionsV293TestJSON-1401063680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d9225a248e74846a14e23c39b73af40',uuid=82e7603c-406f-407f-8893-453c44ebd868,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converting VIF {"id": "a1df8d1c-86a8-4f87-a770-5365dd719443", "address": "fa:16:3e:9e:30:71", "network": {"id": "bdf7da91-6366-4f4b-a368-c964e448c9b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1269615956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01f8d72425c1459c92ad272dcae828a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df8d1c-86", "ovs_interfaceid": "a1df8d1c-86a8-4f87-a770-5365dd719443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_vif [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1df8d1c-86, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:40:16 user nova-compute[72954]: INFO os_vif [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a1df8d1c-86a8-4f87-a770-5365dd719443,network=Network(bdf7da91-6366-4f4b-a368-c964e448c9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df8d1c-86')
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FchOQmvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:40:16 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.066s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e9c7d-d671-44ed-bf37-109871de27ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[660eeab2-4471-4c53-8780-84662cd579a0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:40:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:40:16 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:40:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183f3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b701f-70f8-45d3-b718-a7f3c7a582a9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd8ae2-c6be-4679-a0d0-1c41b011e541]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd5fe90-6942-4f2d-add7-10800e6c83c8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[060274fb-9493-4f67-8ed2-ef99ff1ff06f]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26631626538663532', '/dev/disk/by-id/scsi-1SCST_BIOcf401885-f1be8f52df56170a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf401885') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e2ee7f-1880-46bf-9ee7-5e76e7f8f17f]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fda808d-a863-4df8-a873-4f255b5f8c9b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be5d18-10fd-4e3c-a7fd-b03cc4e4f82e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260]
Sep 04 23:40:16 user nova-compute[72954]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad, portal: 172.16.0.220,3260] successful.
Sep 04 23:40:16 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2db09f32-5798-4b04-bda8-f9b151a9e3ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab78852a-88cb-4306-bdb7-ff0bf47d54db]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.532s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] <== disconnect_volume: return (535ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:40:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deleting instance files /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868_del
Sep 04 23:40:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deletion of /opt/stack/data/nova/instances/82e7603c-406f-407f-8893-453c44ebd868_del complete
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:40:16 user nova-compute[72954]: INFO nova.compute.manager [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Took 1.77 seconds to destroy the instance on the hypervisor.
Sep 04 23:40:16 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:40:16 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:40:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7035MB free_disk=25.067852020263672GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Applying migration context for instance 663bbb50-2a1f-426a-92ba-6e925db7824f as it has an incoming, in-progress migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb. Migration status is finished {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Sep 04 23:40:17 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating resource usage from migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] Acquiring lock "82e7603c-406f-407f-8893-453c44ebd868-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] Lock "82e7603c-406f-407f-8893-453c44ebd868-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] No waiting events found dispatching network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:17 user nova-compute[72954]: WARNING nova.compute.manager [req-aa6978fe-1155-485d-a96e-e14dec959bb8 req-0b7af2b2-6c64-4af7-8c4a-ceb8477d9ae0 service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received unexpected event network-vif-plugged-a1df8d1c-86a8-4f87-a770-5365dd719443 for instance with vm_state active and task_state deleting.
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 82e7603c-406f-407f-8893-453c44ebd868 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 07911333-3216-4cc3-839e-e29f1f561ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a6a888d0-99cd-4c1d-afca-e6f88402739b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:40:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.910s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:40:19 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:19 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Took 2.10 seconds to deallocate network for instance.
Sep 04 23:40:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-b3a62877-f802-419e-83e9-142d92bd05f4 req-cc8dd53a-229c-407b-928e-6481d9652cde service nova] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Received event network-vif-deleted-a1df8d1c-86a8-4f87-a770-5365dd719443 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:20 user nova-compute[72954]: INFO nova.compute.manager [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Terminating instance
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: INFO nova.compute.manager [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Took 1.27 seconds to detach 1 volumes for instance.
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Deleting volume: 2db09f32-5798-4b04-bda8-f9b151a9e3ad {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-afdb1ad3-44b3-4c7e-95f9-6b4177de5c42 req-d1a9432f-404b-4776-b4f9-f2fa2b208d39 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-unplugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:40:20 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Instance destroyed successfully.
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'resources' on Instance uuid a5e51f60-795c-4344-ac17-c7b5b9d9ad97 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1335181665',display_name='tempest-TestMinimumBasicScenario-server-1335181665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1335181665',id=18,image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBIFQ/dVO6Y71c1dd0527QGCsTj4d9ZfWAdUwbxRprb1Mx7Y1rbWK/+SZXiluZ60QXRBueuOMEPJo0tqU+IHxKrvP/0asitbxuqX6e7d16DV4wmI268CaIT1FkMx0V0xQ==',key_name='tempest-TestMinimumBasicScenario-27034824',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-3ovpbklw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2a793278-a4dd-4fbf-b68b-be74cb827870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:37:34Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=a5e51f60-795c-4344-ac17-c7b5b9d9ad97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "b6672997-a4c1-4cf8-acd9-5835c782a958", "address": "fa:16:3e:a4:75:3a", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6672997-a4", "ovs_interfaceid": "b6672997-a4c1-4cf8-acd9-5835c782a958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG os_vif [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6672997-a4, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:40:20 user nova-compute[72954]: INFO os_vif [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:75:3a,bridge_name='br-int',has_traffic_filtering=True,id=b6672997-a4c1-4cf8-acd9-5835c782a958,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6672997-a4')
Sep 04 23:40:20 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Deleting instance files /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97_del
Sep 04 23:40:20 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Deletion of /opt/stack/data/nova/instances/a5e51f60-795c-4344-ac17-c7b5b9d9ad97_del complete
Sep 04 23:40:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:21 user nova-compute[72954]: INFO nova.compute.manager [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Took 1.01 seconds to destroy the instance on the hypervisor.
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.722s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:21 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Deleted allocations for instance 82e7603c-406f-407f-8893-453c44ebd868
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c4704cd0-3824-4dd6-9344-dda6220b52b1 tempest-ServerActionsV293TestJSON-1401063680 tempest-ServerActionsV293TestJSON-1401063680-project-member] Lock "82e7603c-406f-407f-8893-453c44ebd868" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.304s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:22 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Took 1.01 seconds to deallocate network for instance.
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-4458e6de-a253-41bf-bd3b-575663518b7f req-32be8adf-8305-4ab5-8c08-4afc65d20065 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-deleted-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:22 user nova-compute[72954]: INFO nova.compute.manager [req-4458e6de-a253-41bf-bd3b-575663518b7f req-32be8adf-8305-4ab5-8c08-4afc65d20065 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Neutron deleted interface b6672997-a4c1-4cf8-acd9-5835c782a958; detaching it from the instance and deleting it from the info cache
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.network.neutron [req-4458e6de-a253-41bf-bd3b-575663518b7f req-32be8adf-8305-4ab5-8c08-4afc65d20065 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-4458e6de-a253-41bf-bd3b-575663518b7f req-32be8adf-8305-4ab5-8c08-4afc65d20065 service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Detach interface failed, port_id=b6672997-a4c1-4cf8-acd9-5835c782a958, reason: Instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] Acquiring lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] No waiting events found dispatching network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:22 user nova-compute[72954]: WARNING nova.compute.manager [req-5f5f6f4f-0e6c-4b6b-88ee-5390b8304a2a req-a8c2d688-7875-4b01-95fa-c1e675c34f0b service nova] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Received unexpected event network-vif-plugged-b6672997-a4c1-4cf8-acd9-5835c782a958 for instance with vm_state deleted and task_state None.
Sep 04 23:40:22 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Deleted allocations for instance a5e51f60-795c-4344-ac17-c7b5b9d9ad97
Sep 04 23:40:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd99a73c-6831-4cf1-b3e5-5c2ca0fdf873 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "a5e51f60-795c-4344-ac17-c7b5b9d9ad97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.799s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:40:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:31 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870816.1073072, 82e7603c-406f-407f-8893-453c44ebd868 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:31 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 82e7603c-406f-407f-8893-453c44ebd868] VM Stopped (Lifecycle Event)
Sep 04 23:40:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-519b662c-9f11-42e3-a5d2-dea62c0197b7 None None] [instance: 82e7603c-406f-407f-8893-453c44ebd868] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:35 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870820.9277072, a5e51f60-795c-4344-ac17-c7b5b9d9ad97 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:35 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] VM Stopped (Lifecycle Event)
Sep 04 23:40:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-457a1b55-9ddc-4ddc-8fbf-78328d3f6509 None None] [instance: a5e51f60-795c-4344-ac17-c7b5b9d9ad97] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:43 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:40:43 user nova-compute[72954]: INFO nova.compute.claims [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Claim successful on node user
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:40:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.policy [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa79abd0fdf546209e803129a014193e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed107bda33f4121b93cdae99b20b44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:40:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Creating image(s)
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "/opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "/opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk 1073741824" returned: 0 in 0.060s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Successfully created port: d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Cannot resize image /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Ensure instance console log exists: /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Successfully updated port: d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-changed-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Refreshing instance network info cache due to event network-changed-d4d486b4-8913-47a3-95df-4cb4dce4747a. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] Acquiring lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] Acquired lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Refreshing network info cache for port d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "4f400769-805d-4e94-95a3-9bb5426842fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "4f400769-805d-4e94-95a3-9bb5426842fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f5ed1282-76ba-4b58-b31a-d49e7e319676 req-ba74be2e-057a-47c3-844b-17a8b14c62b1 service nova] Releasing lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquired lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:40:46 user nova-compute[72954]: INFO nova.compute.claims [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Claim successful on node user
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updating instance_info_cache with network_info: [{"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Releasing lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance network_info: |[{"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Start _get_guest_xml network_info=[{"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:40:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1371233140',display_name='tempest-VolumesSnapshotTestJSON-instance-1371233140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1371233140',id=27,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrXIHTB0mzf0Oh9ZRcJYkjdjzART6zzLpBWLAUNZeD4X7h7PukvtH+SU8/JXY/+Rll4hXfpt+aJ07kHu5FzrRF84StRBFh/n18oGecZFeobGMBTgbtY9+neJa+Q3U40fw==',key_name='tempest-keypair-493684976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-45ucs9mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=f5cefe1d-e86a-41c1-b92c-52a02bc735ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'pci_devices' on Instance uuid f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:40:46 user nova-compute[72954]:   <uuid>f5cefe1d-e86a-41c1-b92c-52a02bc735ea</uuid>
Sep 04 23:40:46 user nova-compute[72954]:   <name>instance-0000001b</name>
Sep 04 23:40:46 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:40:46 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:40:46 user nova-compute[72954]:   <metadata>
Sep 04 23:40:46 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:40:46 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1371233140</nova:name>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:40:46</nova:creationTime>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:40:46 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:40:46 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:owner>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:user uuid="fa79abd0fdf546209e803129a014193e">tempest-VolumesSnapshotTestJSON-104452992-project-member</nova:user>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:project uuid="2ed107bda33f4121b93cdae99b20b44b">tempest-VolumesSnapshotTestJSON-104452992</nova:project>
Sep 04 23:40:46 user nova-compute[72954]:       </nova:owner>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:40:46 user nova-compute[72954]:       <nova:ports>
Sep 04 23:40:46 user nova-compute[72954]:         <nova:port uuid="d4d486b4-8913-47a3-95df-4cb4dce4747a">
Sep 04 23:40:46 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:40:46 user nova-compute[72954]:         </nova:port>
Sep 04 23:40:46 user nova-compute[72954]:       </nova:ports>
Sep 04 23:40:46 user nova-compute[72954]:     </nova:instance>
Sep 04 23:40:46 user nova-compute[72954]:   </metadata>
Sep 04 23:40:46 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:40:46 user nova-compute[72954]:     <system>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="serial">f5cefe1d-e86a-41c1-b92c-52a02bc735ea</entry>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="uuid">f5cefe1d-e86a-41c1-b92c-52a02bc735ea</entry>
Sep 04 23:40:46 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:40:46 user nova-compute[72954]:     </system>
Sep 04 23:40:46 user nova-compute[72954]:   </sysinfo>
Sep 04 23:40:46 user nova-compute[72954]:   <os>
Sep 04 23:40:46 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:40:46 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:40:46 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:40:46 user nova-compute[72954]:   </os>
Sep 04 23:40:46 user nova-compute[72954]:   <features>
Sep 04 23:40:46 user nova-compute[72954]:     <acpi/>
Sep 04 23:40:46 user nova-compute[72954]:     <apic/>
Sep 04 23:40:46 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:40:46 user nova-compute[72954]:   </features>
Sep 04 23:40:46 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:40:46 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:40:46 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:40:46 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:40:46 user nova-compute[72954]:   </clock>
Sep 04 23:40:46 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:40:46 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:40:46 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:40:46 user nova-compute[72954]:   </cpu>
Sep 04 23:40:46 user nova-compute[72954]:   <devices>
Sep 04 23:40:46 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:40:46 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:40:46 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk"/>
Sep 04 23:40:46 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:40:46 user nova-compute[72954]:     </disk>
Sep 04 23:40:46 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:40:46 user nova-compute[72954]:       <mac address="fa:16:3e:f4:df:95"/>
Sep 04 23:40:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:46 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:40:46 user nova-compute[72954]:       <target dev="tapd4d486b4-89"/>
Sep 04 23:40:46 user nova-compute[72954]:     </interface>
Sep 04 23:40:46 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:40:46 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/console.log" append="off"/>
Sep 04 23:40:46 user nova-compute[72954]:     </serial>
Sep 04 23:40:46 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:40:46 user nova-compute[72954]:     <video>
Sep 04 23:40:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:40:46 user nova-compute[72954]:     </video>
Sep 04 23:40:46 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:40:46 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:40:46 user nova-compute[72954]:     </rng>
Sep 04 23:40:46 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:40:46 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:40:46 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:40:46 user nova-compute[72954]:     </memballoon>
Sep 04 23:40:46 user nova-compute[72954]:   </devices>
Sep 04 23:40:46 user nova-compute[72954]: </domain>
Sep 04 23:40:46 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1371233140',display_name='tempest-VolumesSnapshotTestJSON-instance-1371233140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1371233140',id=27,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrXIHTB0mzf0Oh9ZRcJYkjdjzART6zzLpBWLAUNZeD4X7h7PukvtH+SU8/JXY/+Rll4hXfpt+aJ07kHu5FzrRF84StRBFh/n18oGecZFeobGMBTgbtY9+neJa+Q3U40fw==',key_name='tempest-keypair-493684976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-45ucs9mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=f5cefe1d-e86a-41c1-b92c-52a02bc735ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG os_vif [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d486b4-89, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d486b4-89, col_values=(('external_ids', {'iface-id': 'd4d486b4-8913-47a3-95df-4cb4dce4747a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:df:95', 'vm-uuid': 'f5cefe1d-e86a-41c1-b92c-52a02bc735ea'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:46 user nova-compute[72954]: INFO os_vif [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89')
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:40:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No VIF found with MAC fa:16:3e:f4:df:95, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:40:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.policy [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90f45a06454ddaa392e6cbfe58eeca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4c625d90e54690b8cbb9d0c4cd6e54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:40:47 user nova-compute[72954]: INFO nova.virt.block_device [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Booting with volume-backed-image 6cb1e7a9-0dda-46ae-bceb-c45fe69ede15 at /dev/vda
Sep 04 23:40:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Successfully created port: 77055677-e1b2-489b-97ef-12c279dd3b41 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Successfully updated port: 77055677-e1b2-489b-97ef-12c279dd3b41 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquired lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] No waiting events found dispatching network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:48 user nova-compute[72954]: WARNING nova.compute.manager [req-6ced95b7-6e00-4892-8596-48e686d8a4d3 req-9f737c64-f06a-4ba1-a041-3dc927fb2018 service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received unexpected event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a for instance with vm_state building and task_state spawning.
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Received event network-changed-77055677-e1b2-489b-97ef-12c279dd3b41 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Refreshing instance network info cache due to event network-changed-77055677-e1b2-489b-97ef-12c279dd3b41. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] Acquiring lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:40:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Updating instance_info_cache with network_info: [{"id": "77055677-e1b2-489b-97ef-12c279dd3b41", "address": "fa:16:3e:e1:67:32", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77055677-e1", "ovs_interfaceid": "77055677-e1b2-489b-97ef-12c279dd3b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Releasing lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Instance network_info: |[{"id": "77055677-e1b2-489b-97ef-12c279dd3b41", "address": "fa:16:3e:e1:67:32", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77055677-e1", "ovs_interfaceid": "77055677-e1b2-489b-97ef-12c279dd3b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] Acquired lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Refreshing network info cache for port 77055677-e1b2-489b-97ef-12c279dd3b41 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Updated VIF entry in instance network info cache for port 77055677-e1b2-489b-97ef-12c279dd3b41. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG nova.network.neutron [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Updating instance_info_cache with network_info: [{"id": "77055677-e1b2-489b-97ef-12c279dd3b41", "address": "fa:16:3e:e1:67:32", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77055677-e1", "ovs_interfaceid": "77055677-e1b2-489b-97ef-12c279dd3b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:40:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4021a8ff-6f42-4995-ac74-62c2a34403e9 req-4f5439b5-b86e-42b2-ad85-4523e99dc46d service nova] Releasing lock "refresh_cache-4f400769-805d-4e94-95a3-9bb5426842fb" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] No waiting events found dispatching network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:40:50 user nova-compute[72954]: WARNING nova.compute.manager [req-86444bae-4591-47f0-9bb5-b9771c2f9262 req-bc9fe453-d451-40e1-a740-c47d77f9c0ef service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received unexpected event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a for instance with vm_state building and task_state spawning.
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870850.8322988, f5cefe1d-e86a-41c1-b92c-52a02bc735ea => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] VM Resumed (Lifecycle Event)
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance spawned successfully.
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870850.8346095, f5cefe1d-e86a-41c1-b92c-52a02bc735ea => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] VM Started (Lifecycle Event)
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:40:50 user nova-compute[72954]: INFO nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Took 6.48 seconds to spawn the instance on the hypervisor.
Sep 04 23:40:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:40:51 user nova-compute[72954]: INFO nova.compute.manager [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Took 7.37 seconds to build instance.
Sep 04 23:40:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a09aa00a-ad21-4d6e-a639-88aed48061c5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.496s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:40:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:40:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:41:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.utils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c662ca-cbe0-4c17-aa30-a100fa8d0361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fddaa3-6cde-4f6f-8e66-4839695ff369]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb69f84-7a4c-419d-8cf8-cf11eb86eae9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[48deac44-043d-46c3-82c2-85e2eea770d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:08 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:41:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad02dbe7-3e13-4eff-a547-47f7668b36fb]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG os_brick.utils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:08 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Updating existing volume attachment record: 1864c95c-305c-4d73-9097-06723b87c431 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:41:09 user nova-compute[72954]: INFO nova.compute.claims [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Claim successful on node user
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.035s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.823s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:41:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:41:10 user nova-compute[72954]: INFO nova.virt.block_device [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Booting with volume deec85db-8217-49dc-8137-2a7ef19a8cbf at /dev/vda
Sep 04 23:41:10 user nova-compute[72954]: DEBUG nova.policy [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3694a9f4359a487db80ec71c526201be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2f8d4f90e74533b0f0b96581c8bd5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79782f-0ee0-4b27-bfbb-ab3adc09c93d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c725a17e-49ce-4e4e-b38e-d5ddc6275a9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3da1c9-bb9b-4ea4-88ab-2041c3a3d690]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[34110182-1840-4c34-8502-681ada73a02e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:11 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[566add68-1c8d-4863-bedd-27548e67ba0a]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== get_connector_properties: return (218ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating existing volume attachment record: cddec130-09e2-46a3-aee2-52166a57e0dc {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Successfully created port: 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Successfully updated port: 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-changed-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Refreshing instance network info cache due to event network-changed-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance network_info: |[{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.network.neutron [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Refreshing network info cache for port 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:41:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG nova.network.neutron [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updated VIF entry in instance network info cache for port 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG nova.network.neutron [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-566222e7-a271-4a41-9c42-1734409362a5 req-c85616ae-6468-444c-820f-cbb376de05a5 service nova] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:41:15 user nova-compute[72954]: INFO nova.compute.claims [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Claim successful on node user
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.351s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:41:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=6922MB free_disk=25.0274658203125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:17 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.policy [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b754b34e954e435a97130f83ef9d5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fc8d5e6302420a8056028f7c9bbdf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:41:17 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Creating image(s)
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "/opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "/opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "e675450031f50f090bcc74cce55e93335c412b32" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "e675450031f50f090bcc74cce55e93335c412b32" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Applying migration context for instance 663bbb50-2a1f-426a-92ba-6e925db7824f as it has an incoming, in-progress migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb. Migration status is finished {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Sep 04 23:41:17 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating resource usage from migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 07911333-3216-4cc3-839e-e29f1f561ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a6a888d0-99cd-4c1d-afca-e6f88402739b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4f400769-805d-4e94-95a3-9bb5426842fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.part --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.virt.images [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] 901bf645-4764-4284-bbe9-b1dde76b332b was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.part /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Successfully created port: ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.part /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.converted" returned: 0 in 0.221s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "e675450031f50f090bcc74cce55e93335c412b32" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.253s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.618s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "e675450031f50f090bcc74cce55e93335c412b32" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "e675450031f50f090bcc74cce55e93335c412b32" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json" returned: 0 in 0.234s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32,backing_fmt=raw /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Successfully updated port: ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing instance network info cache due to event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32,backing_fmt=raw /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk 1073741824" returned: 0 in 0.074s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "e675450031f50f090bcc74cce55e93335c412b32" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 --force-share --output=json" returned: 0 in 0.223s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:41:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bd94c3c0-aa52-4488-9f21-e488aa76670f req-80ce2beb-3b2b-4cfb-bffa-58a01fb801e5 service nova] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Cannot resize image /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Ensure instance console log exists: /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance network_info: |[{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Start _get_guest_xml network_info=[{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:41:12Z,direct_url=<?>,disk_format='qcow2',id=901bf645-4764-4284-bbe9-b1dde76b332b,min_disk=0,min_ram=0,name='tempest-scenario-img--962502848',owner='a4fc8d5e6302420a8056028f7c9bbdf6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:41:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '901bf645-4764-4284-bbe9-b1dde76b332b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:41:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:41:12Z,direct_url=<?>,disk_format='qcow2',id=901bf645-4764-4284-bbe9-b1dde76b332b,min_disk=0,min_ram=0,name='tempest-scenario-img--962502848',owner='a4fc8d5e6302420a8056028f7c9bbdf6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:41:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1947844586',display_name='tempest-TestMinimumBasicScenario-server-1947844586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1947844586',id=30,image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+kmECnnCfUZhXZBpj5gHVV2KbyPSeiuDdLM9zaCuAX0b/eW2yG8HBlAQ4G4LWsEaiIVBHNnpBzrQqH/aca3QhI4RnSgyerANe0eDCRfOlov5mbPhjeLAdLR44bwmyPLw==',key_name='tempest-TestMinimumBasicScenario-1613538953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-qj3f4311',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:41:18Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=ed91c1df-b7fe-4289-9e55-2c5e75e55e35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'pci_devices' on Instance uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:41:20 user nova-compute[72954]:   <uuid>ed91c1df-b7fe-4289-9e55-2c5e75e55e35</uuid>
Sep 04 23:41:20 user nova-compute[72954]:   <name>instance-0000001e</name>
Sep 04 23:41:20 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:41:20 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:41:20 user nova-compute[72954]:   <metadata>
Sep 04 23:41:20 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:41:20 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:name>tempest-TestMinimumBasicScenario-server-1947844586</nova:name>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:41:20</nova:creationTime>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:41:20 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:41:20 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:owner>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:user uuid="b754b34e954e435a97130f83ef9d5622">tempest-TestMinimumBasicScenario-339041348-project-member</nova:user>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:project uuid="a4fc8d5e6302420a8056028f7c9bbdf6">tempest-TestMinimumBasicScenario-339041348</nova:project>
Sep 04 23:41:20 user nova-compute[72954]:       </nova:owner>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:root type="image" uuid="901bf645-4764-4284-bbe9-b1dde76b332b"/>
Sep 04 23:41:20 user nova-compute[72954]:       <nova:ports>
Sep 04 23:41:20 user nova-compute[72954]:         <nova:port uuid="ce7d1d21-00e9-4605-9bbb-17a509c6177b">
Sep 04 23:41:20 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:41:20 user nova-compute[72954]:         </nova:port>
Sep 04 23:41:20 user nova-compute[72954]:       </nova:ports>
Sep 04 23:41:20 user nova-compute[72954]:     </nova:instance>
Sep 04 23:41:20 user nova-compute[72954]:   </metadata>
Sep 04 23:41:20 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:41:20 user nova-compute[72954]:     <system>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="serial">ed91c1df-b7fe-4289-9e55-2c5e75e55e35</entry>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="uuid">ed91c1df-b7fe-4289-9e55-2c5e75e55e35</entry>
Sep 04 23:41:20 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:41:20 user nova-compute[72954]:     </system>
Sep 04 23:41:20 user nova-compute[72954]:   </sysinfo>
Sep 04 23:41:20 user nova-compute[72954]:   <os>
Sep 04 23:41:20 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:41:20 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:41:20 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:41:20 user nova-compute[72954]:   </os>
Sep 04 23:41:20 user nova-compute[72954]:   <features>
Sep 04 23:41:20 user nova-compute[72954]:     <acpi/>
Sep 04 23:41:20 user nova-compute[72954]:     <apic/>
Sep 04 23:41:20 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:41:20 user nova-compute[72954]:   </features>
Sep 04 23:41:20 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:41:20 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:41:20 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:41:20 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:41:20 user nova-compute[72954]:   </clock>
Sep 04 23:41:20 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:41:20 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:41:20 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:41:20 user nova-compute[72954]:   </cpu>
Sep 04 23:41:20 user nova-compute[72954]:   <devices>
Sep 04 23:41:20 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:41:20 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:41:20 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk"/>
Sep 04 23:41:20 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:41:20 user nova-compute[72954]:     </disk>
Sep 04 23:41:20 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:41:20 user nova-compute[72954]:       <mac address="fa:16:3e:7f:54:08"/>
Sep 04 23:41:20 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:20 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:41:20 user nova-compute[72954]:       <target dev="tapce7d1d21-00"/>
Sep 04 23:41:20 user nova-compute[72954]:     </interface>
Sep 04 23:41:20 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:41:20 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/console.log" append="off"/>
Sep 04 23:41:20 user nova-compute[72954]:     </serial>
Sep 04 23:41:20 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:41:20 user nova-compute[72954]:     <video>
Sep 04 23:41:20 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:20 user nova-compute[72954]:     </video>
Sep 04 23:41:20 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:41:20 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:41:20 user nova-compute[72954]:     </rng>
Sep 04 23:41:20 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:41:20 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:41:20 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:41:20 user nova-compute[72954]:     </memballoon>
Sep 04 23:41:20 user nova-compute[72954]:   </devices>
Sep 04 23:41:20 user nova-compute[72954]: </domain>
Sep 04 23:41:20 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1947844586',display_name='tempest-TestMinimumBasicScenario-server-1947844586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1947844586',id=30,image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+kmECnnCfUZhXZBpj5gHVV2KbyPSeiuDdLM9zaCuAX0b/eW2yG8HBlAQ4G4LWsEaiIVBHNnpBzrQqH/aca3QhI4RnSgyerANe0eDCRfOlov5mbPhjeLAdLR44bwmyPLw==',key_name='tempest-TestMinimumBasicScenario-1613538953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-qj3f4311',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:41:18Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=ed91c1df-b7fe-4289-9e55-2c5e75e55e35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG os_vif [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce7d1d21-00, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce7d1d21-00, col_values=(('external_ids', {'iface-id': 'ce7d1d21-00e9-4605-9bbb-17a509c6177b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:54:08', 'vm-uuid': 'ed91c1df-b7fe-4289-9e55-2c5e75e55e35'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:20 user nova-compute[72954]: INFO os_vif [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00')
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:41:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No VIF found with MAC fa:16:3e:7f:54:08, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:41:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Port 254899bf-9c89-46ea-8390-fed26be7c8cb binding to destination host user is already ACTIVE {{(pid=72954) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:22 user nova-compute[72954]: WARNING nova.compute.manager [req-67f09ce5-ac30-404b-bfa6-6d8b286f7dbc req-43bd1c26-3e65-4274-bce3-ba6090552d7c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state building and task_state spawning.
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [{"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-2e25e677-e6be-43ef-9663-6c6fdeddf302" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Creating tmpfile /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/tmpi6sb6zz0 to verify with other compute node that the instance is on the same shared storage. {{(pid=72954) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:23 user nova-compute[72954]: WARNING nova.compute.manager [req-3a617476-793a-43ef-b25b-1affe0ef7494 req-a4f9c457-1dcd-49d8-bc63-1d314a54b9de service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state resized and task_state resize_reverting.
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance destroyed successfully.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'resources' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:40:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254899bf-9c, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:24 user nova-compute[72954]: INFO os_vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:24 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df09774-94ec-405d-9c15-96fc09c98703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e75b4c-77d6-4243-89fe-7b4f684eb6f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:24 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13831e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f1fd45-739d-41ad-8772-96c65a9d25f4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257e30d-2e07-4311-a07e-4011431267ea]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e463ee-fe85-4ae2-862b-0ef2d6488736]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870884.6897538, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] VM Resumed (Lifecycle Event)
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance spawned successfully.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7f79e8-0088-40a2-a51d-ec65898afa1e]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd92d2-9f62-467c-a8f2-698b23b20946]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870884.6906772, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] VM Started (Lifecycle Event)
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:24 user nova-compute[72954]: WARNING nova.compute.manager [req-93ca743e-c238-4156-87b8-6a0293daab6e req-d554fd29-0d80-4ef9-adab-5694c0e813e9 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state building and task_state spawning.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda5b51-9e83-4a72-9af0-8f12501b571a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:41:24 user nova-compute[72954]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:41:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Took 6.92 seconds to spawn the instance on the hypervisor.
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[408fe3b8-0365-4d44-a4ef-c307cf15f9f9]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== disconnect_volume: return (365ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:41:24 user nova-compute[72954]: INFO nova.compute.manager [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Took 9.24 seconds to build instance.
Sep 04 23:41:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3a526a2f-57d3-4f09-bb94-c24e448a0aa1 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.390s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.volume.cinder [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Update attachment failed for attachment 1864c95c-305c-4d73-9097-06723b87c431. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Traceback (most recent call last):
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     driver_block_device.attach_block_devices(
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     _log_and_attach(device)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     bdm.attach(*attach_args, **attach_kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 835, in attach
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     super(DriverVolImageBlockDevice, self).attach(
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     ret_val = method(obj, context, *args, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     self._do_attach(context, instance, volume, volume_api,
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     self._volume_attach(context, volume, connector, instance,
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     connection_info = volume_api.attachment_update(
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     res = method(self, ctx, *args, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     res = method(self, ctx, attachment_id, *args, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     with excutils.save_and_reraise_exception():
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     self.force_reraise()
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     raise self.value
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     context, '3.44', skip_version_check=True).attachments.update(
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     return method.func(obj, *args, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     resp = self._update('/attachments/%s' % id, body)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     resp, body = self.api.client.put(url, body=body, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     return self._cs_request(url, 'PUT', **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     return self.request(url, method, **kwargs)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb]     raise exceptions.from_response(resp, body)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab)
Sep 04 23:41:25 user nova-compute[72954]: ERROR nova.compute.manager [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] 
Sep 04 23:41:25 user nova-compute[72954]: DEBUG nova.compute.claims [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Aborting claim: <nova.compute.claims.Claim object at 0x7fd13f00dab0> {{(pid=72954) abort /opt/stack/nova/nova/compute/claims.py:84}}
Sep 04 23:41:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:26 user nova-compute[72954]: WARNING nova.compute.manager [req-4723ae1f-4464-409b-86c5-94cdc7be6a4d req-2d4ac964-8ca3-42de-8722-58540e440606 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state resized and task_state resize_reverting.
Sep 04 23:41:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.655s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Build of instance 4f400769-805d-4e94-95a3-9bb5426842fb aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab) {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.utils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Build of instance 4f400769-805d-4e94-95a3-9bb5426842fb aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3 {{(pid=72954) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.466s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:26 user nova-compute[72954]: ERROR nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Build of instance 4f400769-805d-4e94-95a3-9bb5426842fb aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab): nova.exception.BuildAbortException: Build of instance 4f400769-805d-4e94-95a3-9bb5426842fb aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:f67d2c02-bed9-49c9-b321-fa6d22afa094 was not found.).). (HTTP 500) (Request-ID: req-aec3ae10-b423-4d64-9e06-84004653a0ab)
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Unplugging VIFs for instance {{(pid=72954) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-562156118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-562156118',id=28,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-q0kho0e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:40:47Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=4f400769-805d-4e94-95a3-9bb5426842fb,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77055677-e1b2-489b-97ef-12c279dd3b41", "address": "fa:16:3e:e1:67:32", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77055677-e1", "ovs_interfaceid": "77055677-e1b2-489b-97ef-12c279dd3b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "77055677-e1b2-489b-97ef-12c279dd3b41", "address": "fa:16:3e:e1:67:32", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77055677-e1", "ovs_interfaceid": "77055677-e1b2-489b-97ef-12c279dd3b41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:67:32,bridge_name='br-int',has_traffic_filtering=True,id=77055677-e1b2-489b-97ef-12c279dd3b41,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77055677-e1') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG os_vif [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:67:32,bridge_name='br-int',has_traffic_filtering=True,id=77055677-e1b2-489b-97ef-12c279dd3b41,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77055677-e1') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77055677-e1, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:41:26 user nova-compute[72954]: INFO os_vif [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:67:32,bridge_name='br-int',has_traffic_filtering=True,id=77055677-e1b2-489b-97ef-12c279dd3b41,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77055677-e1')
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Unplugged VIFs for instance {{(pid=72954) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'migration_context' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:26 user nova-compute[72954]: DEBUG nova.objects.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Object Instance<663bbb50-2a1f-426a-92ba-6e925db7824f> lazy-loaded attributes: resources,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:27 user nova-compute[72954]: INFO nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Took 0.57 seconds to deallocate network for instance.
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Detaching volume: a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9 {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Sep 04 23:41:27 user nova-compute[72954]: INFO nova.compute.manager [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Detaching volume a1cc3e77-aa00-4fc5-ae69-70eb9d984bd9
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.696s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 4f400769-805d-4e94-95a3-9bb5426842fb] Skipping driver_detach during remote rebuild. {{(pid=72954) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Sep 04 23:41:27 user nova-compute[72954]: INFO nova.compute.manager [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Swapping old allocation on dict_keys(['1011a3ca-a5c6-4712-8224-4088238dab96']) held by migration 05a55180-f2dc-4668-bc3e-1fac7b43e2eb for instance
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Overwriting current allocation {'allocations': {'1011a3ca-a5c6-4712-8224-4088238dab96': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': '39f3ce2c11044ffd860d87380f4cca0b', 'user_id': '1ecac73ee2f44251a327642041bbd1b3', 'consumer_generation': 1} on consumer 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Sep 04 23:41:27 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Deleted allocations for instance 4f400769-805d-4e94-95a3-9bb5426842fb
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3bebdf52-a09d-4f9d-a6ff-ed7b040e56df tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "4f400769-805d-4e94-95a3-9bb5426842fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.116s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:28 user nova-compute[72954]: INFO nova.compute.manager [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Detaching volume 6c53c357-0db3-4331-baf4-28fb29394f95
Sep 04 23:41:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Attempting to driver detach volume 6c53c357-0db3-4331-baf4-28fb29394f95 from mountpoint /dev/vdb
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Attempting to detach device vdb from instance 44a2a895-06fc-43e9-baab-0d30a22bce90 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:41:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:41:28 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:41:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:41:28 user nova-compute[72954]:   <serial>6c53c357-0db3-4331-baf4-28fb29394f95</serial>
Sep 04 23:41:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:41:28 user nova-compute[72954]: </disk>
Sep 04 23:41:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:41:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdb from instance 44a2a895-06fc-43e9-baab-0d30a22bce90 from the persistent domain config.
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44a2a895-06fc-43e9-baab-0d30a22bce90 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:41:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:41:28 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:41:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:41:28 user nova-compute[72954]:   <serial>6c53c357-0db3-4331-baf4-28fb29394f95</serial>
Sep 04 23:41:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:41:28 user nova-compute[72954]: </disk>
Sep 04 23:41:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b2c45-0735-4e4a-ba09-9118cbe044cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790f1ec-8ed4-47d7-b30e-92562681cb80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3ae71-97ce-4b6b-8e71-8771465461fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb8f3f7-b95a-46db-bd3c-89e3d478ee45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:41:28 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eadb96d-c0b7-467b-aff1-41ffbb574a5a]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693870888.6721034, 44a2a895-06fc-43e9-baab-0d30a22bce90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:41:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdb from instance 44a2a895-06fc-43e9-baab-0d30a22bce90 from the live domain config.
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkuUtgfp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:28 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4acd453-2f66-4fdf-a0a4-6ce03a0c8d61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae93f1-2940-4635-905c-2fbb8d316808]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:28 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:41:28 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:28 user nova-compute[72954]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 (non-flash)
Sep 04 23:41:28 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11825c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402d748-5d60-4b27-886e-0dcd1e607403]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ac4df-ac9b-4c0e-acf8-d7904b7b60b3]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddab6e96-1d05-452e-b723-85c0ad76db55]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e6b4a-1ac5-4213-8119-b4b3dee6325d]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715e603-6ba3-4302-9e6f-b1dfa0a95251]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe341e-0f83-49b2-bfbd-b68dbdff41f2]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260]
Sep 04 23:41:28 user nova-compute[72954]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95, portal: 172.16.0.220,3260] successful.
Sep 04 23:41:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c53c357-0db3-4331-baf4-28fb29394f95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a4b48b-cbdf-47c3-916e-9d8b0402c172]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== disconnect_volume: return (296ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:41:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-23bfd6b7-0999-459f-92c5-981b08e8418b tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.016s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72954) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:30 user nova-compute[72954]: WARNING nova.compute.manager [req-bf0b2729-6540-46b7-84d1-46185c9b093b req-7479af9d-fe79-4ad3-9aec-c453ddc60c75 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state active and task_state powering-off.
Sep 04 23:41:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance destroyed successfully.
Sep 04 23:41:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bfd46bb4-3dda-4864-854e-312f86567576 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.963s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:32 user nova-compute[72954]: WARNING nova.compute.manager [req-64d2b519-4a72-457c-84ca-3f1dc6651e7d req-4b5acaa4-0f03-4669-806d-7714026d99da service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state None.
Sep 04 23:41:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:37 user nova-compute[72954]: INFO nova.compute.manager [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Terminating instance
Sep 04 23:41:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-unplugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] No waiting events found dispatching network-vif-unplugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-b6561606-ebbd-4557-8d1d-f04bc568f9cb req-ce795964-a1c6-45cb-8564-3ee824ae8823 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-unplugged-96ec8726-41b0-410b-85fe-175cc9623ca5 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Instance destroyed successfully.
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.objects.instance [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'resources' on Instance uuid 07911333-3216-4cc3-839e-e29f1f561ee1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2093926272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2093926272',id=23,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:37:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5mtfvwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:39:44Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=07911333-3216-4cc3-839e-e29f1f561ee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "96ec8726-41b0-410b-85fe-175cc9623ca5", "address": "fa:16:3e:3c:6a:0a", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ec8726-41", "ovs_interfaceid": "96ec8726-41b0-410b-85fe-175cc9623ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG os_vif [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ec8726-41, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:38 user nova-compute[72954]: INFO os_vif [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:6a:0a,bridge_name='br-int',has_traffic_filtering=True,id=96ec8726-41b0-410b-85fe-175cc9623ca5,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ec8726-41')
Sep 04 23:41:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Deleting instance files /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1_del
Sep 04 23:41:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Deletion of /opt/stack/data/nova/instances/07911333-3216-4cc3-839e-e29f1f561ee1_del complete
Sep 04 23:41:38 user nova-compute[72954]: INFO nova.compute.manager [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Took 1.01 seconds to destroy the instance on the hypervisor.
Sep 04 23:41:38 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:41:38 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:39 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Took 0.71 seconds to deallocate network for instance.
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74f6a19a-7e53-43fc-b51e-f69ebb0abf66 req-b978e99b-24f2-46c3-af47-e28744594426 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-deleted-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:39 user nova-compute[72954]: INFO nova.compute.manager [req-74f6a19a-7e53-43fc-b51e-f69ebb0abf66 req-b978e99b-24f2-46c3-af47-e28744594426 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Neutron deleted interface 96ec8726-41b0-410b-85fe-175cc9623ca5; detaching it from the instance and deleting it from the info cache
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.network.neutron [req-74f6a19a-7e53-43fc-b51e-f69ebb0abf66 req-b978e99b-24f2-46c3-af47-e28744594426 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-74f6a19a-7e53-43fc-b51e-f69ebb0abf66 req-b978e99b-24f2-46c3-af47-e28744594426 service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Detach interface failed, port_id=96ec8726-41b0-410b-85fe-175cc9623ca5, reason: Instance 07911333-3216-4cc3-839e-e29f1f561ee1 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:41:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870884.4600754, 663bbb50-2a1f-426a-92ba-6e925db7824f => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:39 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Stopped (Lifecycle Event)
Sep 04 23:41:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80f381c1-6d30-4dcc-a168-105d23376341 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] Acquiring lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] Lock "07911333-3216-4cc3-839e-e29f1f561ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] No waiting events found dispatching network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:40 user nova-compute[72954]: WARNING nova.compute.manager [req-e690c3be-1cf1-4367-a85b-fd49f80a536d req-94605a1e-0f53-4984-836a-3542a94ed42b service nova] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Received unexpected event network-vif-plugged-96ec8726-41b0-410b-85fe-175cc9623ca5 for instance with vm_state deleted and task_state None.
Sep 04 23:41:40 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Deleted allocations for instance 07911333-3216-4cc3-839e-e29f1f561ee1
Sep 04 23:41:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35517ac7-b994-4f97-a023-30e2b3c8da38 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "07911333-3216-4cc3-839e-e29f1f561ee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Starting finish_revert_migration {{(pid=72954) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start _get_guest_xml network_info=[{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '663bbb50-2a1f-426a-92ba-6e925db7824f', 'attached_at': '2023-09-04T23:41:45.000000', 'detached_at': '', 'volume_id': '484be8f7-cc1d-4d8f-a135-4f5f54a82fb6', 'serial': '484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '976954a3-3095-4eab-98de-d3109db31963', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:41:44 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:44 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'vcpu_model' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:44 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[575292d9-7d06-4224-b132-380b45f537a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:41:44 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4290b5e-5843-4fc3-ae9c-eb7b3bdb7342]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6] added
Sep 04 23:41:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f40138-ffe7-4528-9fcd-7f2e27aae133]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc9fbd-cb3f-4b01-a3d8-6a0dd932d24b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cENTrKsX" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c248f-dae2-4394-8de5-2825b5aa806f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cENTrKsX'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[76761b10-bfe5-4c2c-8c91-34b09f26c715]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b9d6fe-d940-4200-bd57-b7b8a62e6844]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[67efde69-50a6-4be8-826a-0276c411826b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:41:45 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:41:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f90a9-cef6-4a70-9c1d-a977e0aed1b1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422e22f-eb76-4dd0-a0fd-2cba184e111b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:45 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a20f00-a99a-4fdd-81f7-28eecd6fdb96]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:41:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870891.0463614, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:46 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Stopped (Lifecycle Event)
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-63ef8f82-3df7-4e09-af65-5871d001b36b None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-63ef8f82-3df7-4e09-af65-5871d001b36b None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161633062646431', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:41:46 user nova-compute[72954]:   <uuid>663bbb50-2a1f-426a-92ba-6e925db7824f</uuid>
Sep 04 23:41:46 user nova-compute[72954]:   <name>instance-00000014</name>
Sep 04 23:41:46 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:41:46 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:41:46 user nova-compute[72954]:   <metadata>
Sep 04 23:41:46 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:41:46 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherB-server-1752440406</nova:name>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:41:44</nova:creationTime>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:41:46 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:41:46 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:owner>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:user uuid="1ecac73ee2f44251a327642041bbd1b3">tempest-ServerActionsTestOtherB-1198156614-project-member</nova:user>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:project uuid="39f3ce2c11044ffd860d87380f4cca0b">tempest-ServerActionsTestOtherB-1198156614</nova:project>
Sep 04 23:41:46 user nova-compute[72954]:       </nova:owner>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:41:46 user nova-compute[72954]:       <nova:ports>
Sep 04 23:41:46 user nova-compute[72954]:         <nova:port uuid="254899bf-9c89-46ea-8390-fed26be7c8cb">
Sep 04 23:41:46 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 04 23:41:46 user nova-compute[72954]:         </nova:port>
Sep 04 23:41:46 user nova-compute[72954]:       </nova:ports>
Sep 04 23:41:46 user nova-compute[72954]:     </nova:instance>
Sep 04 23:41:46 user nova-compute[72954]:   </metadata>
Sep 04 23:41:46 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:41:46 user nova-compute[72954]:     <system>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="serial">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="uuid">663bbb50-2a1f-426a-92ba-6e925db7824f</entry>
Sep 04 23:41:46 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:41:46 user nova-compute[72954]:     </system>
Sep 04 23:41:46 user nova-compute[72954]:   </sysinfo>
Sep 04 23:41:46 user nova-compute[72954]:   <os>
Sep 04 23:41:46 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:41:46 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:41:46 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:41:46 user nova-compute[72954]:   </os>
Sep 04 23:41:46 user nova-compute[72954]:   <features>
Sep 04 23:41:46 user nova-compute[72954]:     <acpi/>
Sep 04 23:41:46 user nova-compute[72954]:     <apic/>
Sep 04 23:41:46 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:41:46 user nova-compute[72954]:   </features>
Sep 04 23:41:46 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:41:46 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:41:46 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:41:46 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:41:46 user nova-compute[72954]:   </clock>
Sep 04 23:41:46 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:41:46 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:41:46 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:41:46 user nova-compute[72954]:   </cpu>
Sep 04 23:41:46 user nova-compute[72954]:   <devices>
Sep 04 23:41:46 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:41:46 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:41:46 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk"/>
Sep 04 23:41:46 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:41:46 user nova-compute[72954]:     </disk>
Sep 04 23:41:46 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:41:46 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:41:46 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:41:46 user nova-compute[72954]:       <target dev="vdb" bus="virtio"/>
Sep 04 23:41:46 user nova-compute[72954]:       <serial>484be8f7-cc1d-4d8f-a135-4f5f54a82fb6</serial>
Sep 04 23:41:46 user nova-compute[72954]:     </disk>
Sep 04 23:41:46 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:41:46 user nova-compute[72954]:       <mac address="fa:16:3e:c9:89:d0"/>
Sep 04 23:41:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:46 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:41:46 user nova-compute[72954]:       <target dev="tap254899bf-9c"/>
Sep 04 23:41:46 user nova-compute[72954]:     </interface>
Sep 04 23:41:46 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:41:46 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/console.log" append="off"/>
Sep 04 23:41:46 user nova-compute[72954]:     </serial>
Sep 04 23:41:46 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:41:46 user nova-compute[72954]:     <video>
Sep 04 23:41:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:46 user nova-compute[72954]:     </video>
Sep 04 23:41:46 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:41:46 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:41:46 user nova-compute[72954]:     </rng>
Sep 04 23:41:46 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:41:46 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:41:46 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:41:46 user nova-compute[72954]:     </memballoon>
Sep 04 23:41:46 user nova-compute[72954]:   </devices>
Sep 04 23:41:46 user nova-compute[72954]: </domain>
Sep 04 23:41:46 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG os_vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254899bf-9c, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap254899bf-9c, col_values=(('external_ids', {'iface-id': '254899bf-9c89-46ea-8390-fed26be7c8cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:89:d0', 'vm-uuid': '663bbb50-2a1f-426a-92ba-6e925db7824f'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:46 user nova-compute[72954]: INFO os_vif [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:41:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:48 user nova-compute[72954]: WARNING nova.compute.manager [req-83b07129-0900-4879-bb2a-b5023a5b6746 req-7deb038e-7f5e-4550-ba4e-1d894409ae01 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state resized and task_state resize_reverting.
Sep 04 23:41:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:49 user nova-compute[72954]: INFO nova.compute.manager [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Terminating instance
Sep 04 23:41:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-unplugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] No waiting events found dispatching network-vif-unplugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-eac9bdb3-51a6-454d-8d99-7b0317254d78 req-9c3d65cf-1536-415c-aac4-fc177bc7fdb8 service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-unplugged-59205384-bd4c-4b4e-95a7-753c5298416e for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:50 user nova-compute[72954]: WARNING nova.compute.manager [req-6e773ed7-bf1b-4727-ba65-c12ccaa5ccf6 req-24536583-c9c1-4d71-8769-267cd97d7a1e service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state resized and task_state resize_reverting.
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870910.2722251, 663bbb50-2a1f-426a-92ba-6e925db7824f => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Resumed (Lifecycle Event)
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance running successfully.
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] finish_revert_migration finished successfully. {{(pid=72954) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870910.2773366, 663bbb50-2a1f-426a-92ba-6e925db7824f => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Started (Lifecycle Event)
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-a43fc807-6616-4c00-b5fa-ee1964b43745 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance to original state: 'active'
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Instance destroyed successfully.
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lazy-loading 'resources' on Instance uuid a6a888d0-99cd-4c1d-afca-e6f88402739b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-498704995',display_name='tempest-ServersNegativeTestJSON-server-498704995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-498704995',id=26,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-ocbabixe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:40:09Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=a6a888d0-99cd-4c1d-afca-e6f88402739b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "59205384-bd4c-4b4e-95a7-753c5298416e", "address": "fa:16:3e:f1:70:3f", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59205384-bd", "ovs_interfaceid": "59205384-bd4c-4b4e-95a7-753c5298416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG os_vif [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59205384-bd, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:50 user nova-compute[72954]: INFO os_vif [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:70:3f,bridge_name='br-int',has_traffic_filtering=True,id=59205384-bd4c-4b4e-95a7-753c5298416e,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59205384-bd')
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Deleting instance files /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b_del
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Deletion of /opt/stack/data/nova/instances/a6a888d0-99cd-4c1d-afca-e6f88402739b_del complete
Sep 04 23:41:50 user nova-compute[72954]: INFO nova.compute.manager [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Took 1.00 seconds to destroy the instance on the hypervisor.
Sep 04 23:41:50 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:41:50 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:51 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Took 0.49 seconds to deallocate network for instance.
Sep 04 23:41:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-ffefb6e2-b808-4105-b262-2f38e3cb3f0f req-195c8133-95e7-4d66-a7a0-076b2be723ae service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-deleted-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:51 user nova-compute[72954]: INFO nova.compute.manager [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Unrescuing
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:51 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Deleted allocations for instance a6a888d0-99cd-4c1d-afca-e6f88402739b
Sep 04 23:41:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d7c058d7-659f-422f-9fb7-cbbbbe7b3273 tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] Acquiring lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] Lock "a6a888d0-99cd-4c1d-afca-e6f88402739b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] No waiting events found dispatching network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:52 user nova-compute[72954]: WARNING nova.compute.manager [req-625e74b0-0254-4b73-9fec-c49b8f422213 req-933005bd-0d3a-4825-a188-f5ab35beb4fe service nova] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Received unexpected event network-vif-plugged-59205384-bd4c-4b4e-95a7-753c5298416e for instance with vm_state deleted and task_state None.
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'flavor' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:52 user nova-compute[72954]: WARNING nova.compute.manager [req-75669dd2-5fa2-4e76-8886-4de366b2fe3c req-24fbcd8b-94bf-481b-8100-ddff05102a68 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:41:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance destroyed successfully.
Sep 04 23:41:53 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870898.5302787, 07911333-3216-4cc3-839e-e29f1f561ee1 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:53 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] VM Stopped (Lifecycle Event)
Sep 04 23:41:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-18f00cae-7dd0-48a3-a248-86e888c8292b None None] [instance: 07911333-3216-4cc3-839e-e29f1f561ee1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:54 user nova-compute[72954]: WARNING nova.compute.manager [req-57fc47c6-af19-4122-8baa-b6ca9f09ba29 req-c23cc8ec-f32b-4b15-9c41-0c0630a9eb73 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:41:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:41:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Creating image(s)
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Ensure instance console log exists: /opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start _get_guest_xml network_info=[{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bab57e0-c079-4701-9d61-7dd1a050068c', 'attached_at': '', 'detached_at': '', 'volume_id': 'deec85db-8217-49dc-8137-2a7ef19a8cbf', 'serial': 'deec85db-8217-49dc-8137-2a7ef19a8cbf'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'cddec130-09e2-46a3-aee2-52166a57e0dc', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:41:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:55 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:41:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:41:55 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259eb19-8fb7-435e-ba8a-7daa9c9cb5f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:41:55 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e5ccd-fdf2-43b7-bee9-b4b513a4a879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf] added
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948c28e-1900-4b87-a51d-c562ba9a5926]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864623c-63ca-4cc1-beab-50b51a4ff48b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZeOPTpB {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZeOPTpB" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a190ce-833d-46e1-bf69-f35cb85aed1f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZeOPTpB'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fba16b6-ceae-4003-b4fb-207c8bdecb0a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb902da-edf5-4484-8ab4-2134fa092b50]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5cf306-0337-4ace-8cda-5d068702700c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]
Sep 04 23:41:55 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[244192ef-23ac-4a65-a858-e37b7a068d76]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20fd4f3-4555-444b-a88e-718b19cc8ab1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:41:55 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:41:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[78080c32-4ec3-4ac5-83d0-20d4f6af0f42]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:41:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26433373064653666', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373064653666', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bab57e0-c079-4701-9d61-7dd1a050068c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:41:56 user nova-compute[72954]:   <uuid>2bab57e0-c079-4701-9d61-7dd1a050068c</uuid>
Sep 04 23:41:56 user nova-compute[72954]:   <name>instance-0000001d</name>
Sep 04 23:41:56 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:41:56 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:41:56 user nova-compute[72954]:   <metadata>
Sep 04 23:41:56 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:41:56 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:41:56 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherA-server-915815952</nova:name>
Sep 04 23:41:56 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:41:55</nova:creationTime>
Sep 04 23:41:56 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:41:56 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:41:56 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:41:56 user nova-compute[72954]:       <nova:owner>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:user uuid="3694a9f4359a487db80ec71c526201be">tempest-ServerActionsTestOtherA-520106611-project-member</nova:user>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:project uuid="9c2f8d4f90e74533b0f0b96581c8bd5a">tempest-ServerActionsTestOtherA-520106611</nova:project>
Sep 04 23:41:56 user nova-compute[72954]:       </nova:owner>
Sep 04 23:41:56 user nova-compute[72954]:       <nova:ports>
Sep 04 23:41:56 user nova-compute[72954]:         <nova:port uuid="3562d996-1212-4b5c-a48d-9f9dc4fa6f1b">
Sep 04 23:41:56 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:41:56 user nova-compute[72954]:         </nova:port>
Sep 04 23:41:56 user nova-compute[72954]:       </nova:ports>
Sep 04 23:41:56 user nova-compute[72954]:     </nova:instance>
Sep 04 23:41:56 user nova-compute[72954]:   </metadata>
Sep 04 23:41:56 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:41:56 user nova-compute[72954]:     <system>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="serial">2bab57e0-c079-4701-9d61-7dd1a050068c</entry>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="uuid">2bab57e0-c079-4701-9d61-7dd1a050068c</entry>
Sep 04 23:41:56 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:41:56 user nova-compute[72954]:     </system>
Sep 04 23:41:56 user nova-compute[72954]:   </sysinfo>
Sep 04 23:41:56 user nova-compute[72954]:   <os>
Sep 04 23:41:56 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:41:56 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:41:56 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:41:56 user nova-compute[72954]:   </os>
Sep 04 23:41:56 user nova-compute[72954]:   <features>
Sep 04 23:41:56 user nova-compute[72954]:     <acpi/>
Sep 04 23:41:56 user nova-compute[72954]:     <apic/>
Sep 04 23:41:56 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:41:56 user nova-compute[72954]:   </features>
Sep 04 23:41:56 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:41:56 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:41:56 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:41:56 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:41:56 user nova-compute[72954]:   </clock>
Sep 04 23:41:56 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:41:56 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:41:56 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:41:56 user nova-compute[72954]:   </cpu>
Sep 04 23:41:56 user nova-compute[72954]:   <devices>
Sep 04 23:41:56 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:41:56 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:41:56 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 04 23:41:56 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:41:56 user nova-compute[72954]:       <serial>deec85db-8217-49dc-8137-2a7ef19a8cbf</serial>
Sep 04 23:41:56 user nova-compute[72954]:     </disk>
Sep 04 23:41:56 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:41:56 user nova-compute[72954]:       <mac address="fa:16:3e:d6:d5:41"/>
Sep 04 23:41:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:56 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:41:56 user nova-compute[72954]:       <target dev="tap3562d996-12"/>
Sep 04 23:41:56 user nova-compute[72954]:     </interface>
Sep 04 23:41:56 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:41:56 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c/console.log" append="off"/>
Sep 04 23:41:56 user nova-compute[72954]:     </serial>
Sep 04 23:41:56 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:41:56 user nova-compute[72954]:     <video>
Sep 04 23:41:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:41:56 user nova-compute[72954]:     </video>
Sep 04 23:41:56 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:41:56 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:41:56 user nova-compute[72954]:     </rng>
Sep 04 23:41:56 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:41:56 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:41:56 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:41:56 user nova-compute[72954]:     </memballoon>
Sep 04 23:41:56 user nova-compute[72954]:   </devices>
Sep 04 23:41:56 user nova-compute[72954]: </domain>
Sep 04 23:41:56 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG os_vif [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3562d996-12, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3562d996-12, col_values=(('external_ids', {'iface-id': '3562d996-1212-4b5c-a48d-9f9dc4fa6f1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:41', 'vm-uuid': '2bab57e0-c079-4701-9d61-7dd1a050068c'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:56 user nova-compute[72954]: INFO os_vif [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12')
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:56 user nova-compute[72954]: WARNING nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:56 user nova-compute[72954]: WARNING nova.compute.manager [req-73b05f68-7b29-482f-bc5b-f220a9107896 req-a396572c-1ebd-4359-9481-f879ea13be21 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state rescued and task_state unrescuing.
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:41:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:d6:d5:41, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for c88b8e02-ab4d-4c55-8e32-d61e8674121c due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870917.0572872, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Resumed (Lifecycle Event)
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5b97bfb3-1960-4e00-86bd-5be867bcb291 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870917.0613818, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:41:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Started (Lifecycle Event)
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:41:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:41:58 user nova-compute[72954]: WARNING nova.compute.manager [req-cc53a876-4d68-4bb5-ac10-962a7a766f1e req-a19ef800-da09-43ab-8697-25060ba488fa service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state building and task_state spawning.
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:41:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:42:00 user nova-compute[72954]: WARNING nova.compute.manager [req-e0549dbc-54ba-4411-bffd-2e899a2f2863 req-34a205e9-61f5-45bc-803b-e70c7c980818 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state building and task_state spawning.
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870920.5704656, 2bab57e0-c079-4701-9d61-7dd1a050068c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Resumed (Lifecycle Event)
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance spawned successfully.
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693870920.5749295, 2bab57e0-c079-4701-9d61-7dd1a050068c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Started (Lifecycle Event)
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Took 5.66 seconds to spawn the instance on the hypervisor.
Sep 04 23:42:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:42:00 user nova-compute[72954]: INFO nova.compute.manager [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Took 51.15 seconds to build instance.
Sep 04 23:42:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b04f8f31-3b17-4219-a14b-f6912988544c tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.257s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:05 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870910.566689, a6a888d0-99cd-4c1d-afca-e6f88402739b => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:42:05 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] VM Stopped (Lifecycle Event)
Sep 04 23:42:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-645d5e7b-1565-4fb9-a0ba-0fd7cd152571 None None] [instance: a6a888d0-99cd-4c1d-afca-e6f88402739b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:42:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:09 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:42:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7150MB free_disk=25.094085693359375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2e25e677-e6be-43ef-9663-6c6fdeddf302 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:42:15 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:42:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:42:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:42:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:42:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [{"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-663bbb50-2a1f-426a-92ba-6e925db7824f" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:42:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:42:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:28 user nova-compute[72954]: INFO nova.compute.manager [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Terminating instance
Sep 04 23:42:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-7d824118-cf97-4e16-a6d6-0823273ba5a8 req-3c39b9a2-6518-478c-9c8f-4b3e72aab435 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-unplugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Instance destroyed successfully.
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'resources' on Instance uuid 2e25e677-e6be-43ef-9663-6c6fdeddf302 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1198513030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1198513030',id=14,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-y5i7yepr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:36:00Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=2e25e677-e6be-43ef-9663-6c6fdeddf302,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "address": "fa:16:3e:4b:cb:d8", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc15794-54", "ovs_interfaceid": "9dc15794-54ed-4c11-a4d7-76c4c3f2b92c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_vif [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dc15794-54, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:29 user nova-compute[72954]: INFO os_vif [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=9dc15794-54ed-4c11-a4d7-76c4c3f2b92c,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc15794-54')
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rsukmZjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:42:29 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172999c-3a16-4359-94fc-38abc22746a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d7a44-3f1d-4dee-8c22-8cb196bc2b5b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:29 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183af9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d'): ({'sdi'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Removing single pathed devices sdi {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d215479-b224-48f8-9e8e-45ffb27237cc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e82177-6698-42d7-8cc4-57715a6f0b6b]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Flushing IO for device /dev/sdi {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e1dda-6e9d-45e1-bb68-c239916b1a0d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[332ca449-38ab-4340-b5e1-8557e10907f1]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] SCSI volumes sdi have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b729974-1add-4be2-8d7f-361357f8eb53]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf590c-4446-47d4-a77e-6411565ea1b3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260]
Sep 04 23:42:29 user nova-compute[72954]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d, portal: 172.16.0.220,3260] successful.
Sep 04 23:42:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96933111-ff82-4d21-a7e8-79822ca9489d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f75630-2ef7-42f2-850c-d993c2b47503]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] <== disconnect_volume: return (323ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:42:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Deleting instance files /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302_del
Sep 04 23:42:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Deletion of /opt/stack/data/nova/instances/2e25e677-e6be-43ef-9663-6c6fdeddf302_del complete
Sep 04 23:42:29 user nova-compute[72954]: INFO nova.compute.manager [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Took 1.20 seconds to destroy the instance on the hypervisor.
Sep 04 23:42:29 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:42:29 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:42:29 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Took 0.44 seconds to deallocate network for instance.
Sep 04 23:42:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:42:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] Acquiring lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] No waiting events found dispatching network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:42:30 user nova-compute[72954]: WARNING nova.compute.manager [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received unexpected event network-vif-plugged-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c for instance with vm_state active and task_state deleting.
Sep 04 23:42:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd080a09-6e26-4278-a441-015751b684d8 req-aa4c7519-79dd-4f49-950d-b7cb5ca56060 service nova] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Received event network-vif-deleted-9dc15794-54ed-4c11-a4d7-76c4c3f2b92c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:42:30 user nova-compute[72954]: INFO nova.compute.manager [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Took 0.96 seconds to detach 1 volumes for instance.
Sep 04 23:42:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:31 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Deleted allocations for instance 2e25e677-e6be-43ef-9663-6c6fdeddf302
Sep 04 23:42:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-eb8aec9e-246a-4503-9eab-c1b89cb70c1f tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "2e25e677-e6be-43ef-9663-6c6fdeddf302" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.181s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-changed-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Refreshing instance network info cache due to event network-changed-d4d486b4-8913-47a3-95df-4cb4dce4747a. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] Acquiring lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] Acquired lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Refreshing network info cache for port d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:42:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Ignoring supplied device name: /dev/vdb
Sep 04 23:42:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updated VIF entry in instance network info cache for port d4d486b4-8913-47a3-95df-4cb4dce4747a. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updating instance_info_cache with network_info: [{"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:42:35 user nova-compute[72954]: INFO nova.compute.manager [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Attaching volume 50dfa82d-7805-4fe7-8691-08bee5b9f58d to /dev/vdb
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7c6f6ccb-e739-4905-b7e8-50d7b4b5743e req-105cae71-ddc7-4012-9037-6a82fe86f58d service nova] Releasing lock "refresh_cache-f5cefe1d-e86a-41c1-b92c-52a02bc735ea" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.utils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d565b-108f-411e-90c9-d1692855317e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888b922-3790-4da7-b29e-118970335a06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6377e739-91db-4f62-bfcd-b37ee0df703e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb46da4-429d-4368-b19f-305b44128217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:42:35 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:42:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4963102f-e12b-4f64-8d3f-db4a6f27a5b5]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG os_brick.utils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:42:35 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updating existing volume attachment record: fef6633e-5cb1-4a57-8295-748406013ad7 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:42:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:44 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870949.0814748, 2e25e677-e6be-43ef-9663-6c6fdeddf302 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:42:44 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] VM Stopped (Lifecycle Event)
Sep 04 23:42:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9ba16ecc-0a35-4059-9b16-2e15f51dd36a None None] [instance: 2e25e677-e6be-43ef-9663-6c6fdeddf302] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:42:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxcKrmDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:42:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:42:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:42:49 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dba926-fbf5-4a4c-8d7b-11771f62594d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:42:49 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e015ff-1a35-4182-8b2b-b0222b9cb6b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d] added
Sep 04 23:42:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9e94e2-b302-49c9-bf9c-ea5d55ed2e0c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a97f3-1748-4cc1-b00e-62504b1cf9cf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxcKrmDT {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxcKrmDT" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf44565-661e-4239-b14e-293d359789cc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxcKrmDT'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c040a2f-b6d0-46d0-8958-ccd1dba17233]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e4817e-d189-47d5-9621-86c41a9be941]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:49 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:49 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:49 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:49 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d946a-e38c-4a19-a970-69ed6e21b4be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260]
Sep 04 23:42:49 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260] successful.
Sep 04 23:42:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f508a2-a6ca-4bde-b96e-0ecaa70baf02]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:42:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e7cea-a41a-4428-8b88-30fa053316e9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:42:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:42:50 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:42:50 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb350d5-cc1b-4838-b31f-bf0fa72d0b4e]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:42:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxcKrmDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23461323034313432', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461323034313432', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:42:51 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:42:51 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:42:51 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:42:51 user nova-compute[72954]:   <serial>50dfa82d-7805-4fe7-8691-08bee5b9f58d</serial>
Sep 04 23:42:51 user nova-compute[72954]: </disk>
Sep 04 23:42:51 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No VIF found with MAC fa:16:3e:f4:df:95, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:42:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d7f52b4-e5a9-487a-9b7d-9575e642151c tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.640s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:42:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:42:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:43:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:11 user nova-compute[72954]: INFO nova.compute.manager [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Attaching volume 4d139c8a-9762-4d69-96a0-01e285ca96f5 to /dev/vdb
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71866d8-c553-4131-924e-60d3e916157e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fec15-1107-4f4c-98a4-52e1b62b0686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[68adccba-b0b5-4e95-bac7-c10d5ac59f38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db6cab2-6704-4a29-823e-1fc60714df4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:43:11 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0a9b5-a441-4b0d-bf4e-2dc35f7bf816]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG os_brick.utils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating existing volume attachment record: 32548179-afa0-40eb-ad1a-18d90ce41a74 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:43:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:14 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:43:14 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:43:14 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7274MB free_disk=25.090377807617188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:14 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b74564bb-948a-43be-81b7-8504f4dc023a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:43:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:19 user nova-compute[72954]: INFO nova.compute.manager [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Terminating instance
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-unplugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] No waiting events found dispatching network-vif-unplugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-f342beca-0026-435e-83bc-b7314fc34d11 req-a8b6b2bd-20e4-41ea-a085-bc612e240354 service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-unplugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:43:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Instance destroyed successfully.
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.objects.instance [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lazy-loading 'resources' on Instance uuid b74564bb-948a-43be-81b7-8504f4dc023a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1232196010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1232196010',id=3,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4c625d90e54690b8cbb9d0c4cd6e54',ramdisk_id='',reservation_id='r-847202ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-974522082',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:09Z,user_data=None,user_id='9f90f45a06454ddaa392e6cbfe58eeca',uuid=b74564bb-948a-43be-81b7-8504f4dc023a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converting VIF {"id": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "address": "fa:16:3e:a4:97:4d", "network": {"id": "6fcb2e04-9ea9-434f-9773-53fe8205dc9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-941307431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4c625d90e54690b8cbb9d0c4cd6e54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e91e7a-48", "ovs_interfaceid": "64e91e7a-48a2-47ca-aed2-6993b652e5f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG os_vif [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64e91e7a-48, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:19 user nova-compute[72954]: INFO os_vif [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:97:4d,bridge_name='br-int',has_traffic_filtering=True,id=64e91e7a-48a2-47ca-aed2-6993b652e5f3,network=Network(6fcb2e04-9ea9-434f-9773-53fe8205dc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e91e7a-48')
Sep 04 23:43:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Deleting instance files /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a_del
Sep 04 23:43:19 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Deletion of /opt/stack/data/nova/instances/b74564bb-948a-43be-81b7-8504f4dc023a_del complete
Sep 04 23:43:19 user nova-compute[72954]: INFO nova.compute.manager [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Took 0.72 seconds to destroy the instance on the hypervisor.
Sep 04 23:43:19 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:43:19 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-fbc5839e-e05f-47a4-b9a8-e20e8b684eb8 req-c6df9a72-fd60-4afc-9553-48e45235a98a service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-deleted-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:20 user nova-compute[72954]: INFO nova.compute.manager [req-fbc5839e-e05f-47a4-b9a8-e20e8b684eb8 req-c6df9a72-fd60-4afc-9553-48e45235a98a service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Neutron deleted interface 64e91e7a-48a2-47ca-aed2-6993b652e5f3; detaching it from the instance and deleting it from the info cache
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-fbc5839e-e05f-47a4-b9a8-e20e8b684eb8 req-c6df9a72-fd60-4afc-9553-48e45235a98a service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:20 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Took 0.66 seconds to deallocate network for instance.
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-fbc5839e-e05f-47a4-b9a8-e20e8b684eb8 req-c6df9a72-fd60-4afc-9553-48e45235a98a service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Detach interface failed, port_id=64e91e7a-48a2-47ca-aed2-6993b652e5f3, reason: Instance b74564bb-948a-43be-81b7-8504f4dc023a could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:43:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:20 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Deleted allocations for instance b74564bb-948a-43be-81b7-8504f4dc023a
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f17f378b-a510-4167-bff2-0308a11be316 tempest-ServerBootFromVolumeStableRescueTest-974522082 tempest-ServerBootFromVolumeStableRescueTest-974522082-project-member] Lock "b74564bb-948a-43be-81b7-8504f4dc023a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] Acquiring lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] Lock "b74564bb-948a-43be-81b7-8504f4dc023a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] No waiting events found dispatching network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:21 user nova-compute[72954]: WARNING nova.compute.manager [req-83476c72-05e1-4098-8de3-d2ffea419f49 req-aff9f106-d955-4160-bf5a-b9dfd0b6a0ad service nova] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Received unexpected event network-vif-plugged-64e91e7a-48a2-47ca-aed2-6993b652e5f3 for instance with vm_state deleted and task_state None.
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'info_cache' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:43:22 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance destroyed successfully.
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'resources' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG os_vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ca716a-b3, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:43:22 user nova-compute[72954]: INFO os_vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start _get_guest_xml network_info=[{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'numa_topology' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:22 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:43:22 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'pci_devices' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:43:22 user nova-compute[72954]:   <uuid>44a2a895-06fc-43e9-baab-0d30a22bce90</uuid>
Sep 04 23:43:22 user nova-compute[72954]:   <name>instance-00000015</name>
Sep 04 23:43:22 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:43:22 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:43:22 user nova-compute[72954]:   <metadata>
Sep 04 23:43:22 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:43:22 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeTestJSON-server-2106306957</nova:name>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:43:22</nova:creationTime>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:43:22 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:43:22 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:owner>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:user uuid="d2c3ec932cc64d98a8b1b6c10dd6f432">tempest-AttachVolumeTestJSON-79448822-project-member</nova:user>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:project uuid="9857524a888d4d9f9d3e48341500411a">tempest-AttachVolumeTestJSON-79448822</nova:project>
Sep 04 23:43:22 user nova-compute[72954]:       </nova:owner>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:43:22 user nova-compute[72954]:       <nova:ports>
Sep 04 23:43:22 user nova-compute[72954]:         <nova:port uuid="28ca716a-b39a-4923-8261-36a8a99899cf">
Sep 04 23:43:22 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Sep 04 23:43:22 user nova-compute[72954]:         </nova:port>
Sep 04 23:43:22 user nova-compute[72954]:       </nova:ports>
Sep 04 23:43:22 user nova-compute[72954]:     </nova:instance>
Sep 04 23:43:22 user nova-compute[72954]:   </metadata>
Sep 04 23:43:22 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:43:22 user nova-compute[72954]:     <system>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="serial">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="uuid">44a2a895-06fc-43e9-baab-0d30a22bce90</entry>
Sep 04 23:43:22 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:43:22 user nova-compute[72954]:     </system>
Sep 04 23:43:22 user nova-compute[72954]:   </sysinfo>
Sep 04 23:43:22 user nova-compute[72954]:   <os>
Sep 04 23:43:22 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:43:22 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:43:22 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:43:22 user nova-compute[72954]:   </os>
Sep 04 23:43:22 user nova-compute[72954]:   <features>
Sep 04 23:43:22 user nova-compute[72954]:     <acpi/>
Sep 04 23:43:22 user nova-compute[72954]:     <apic/>
Sep 04 23:43:22 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:43:22 user nova-compute[72954]:   </features>
Sep 04 23:43:22 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:43:22 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:43:22 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:43:22 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:43:22 user nova-compute[72954]:   </clock>
Sep 04 23:43:22 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:43:22 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:43:22 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:43:22 user nova-compute[72954]:   </cpu>
Sep 04 23:43:22 user nova-compute[72954]:   <devices>
Sep 04 23:43:22 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:43:22 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:43:22 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk"/>
Sep 04 23:43:22 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:43:22 user nova-compute[72954]:     </disk>
Sep 04 23:43:22 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:43:22 user nova-compute[72954]:       <mac address="fa:16:3e:d0:ea:8a"/>
Sep 04 23:43:22 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:43:22 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:43:22 user nova-compute[72954]:       <target dev="tap28ca716a-b3"/>
Sep 04 23:43:22 user nova-compute[72954]:     </interface>
Sep 04 23:43:22 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:43:22 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/console.log" append="off"/>
Sep 04 23:43:22 user nova-compute[72954]:     </serial>
Sep 04 23:43:22 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:43:22 user nova-compute[72954]:     <video>
Sep 04 23:43:22 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:43:22 user nova-compute[72954]:     </video>
Sep 04 23:43:22 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:43:22 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:43:22 user nova-compute[72954]:     </rng>
Sep 04 23:43:22 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:43:22 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:43:22 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:43:22 user nova-compute[72954]:     </memballoon>
Sep 04 23:43:22 user nova-compute[72954]:   </devices>
Sep 04 23:43:22 user nova-compute[72954]: </domain>
Sep 04 23:43:22 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [{"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-44a2a895-06fc-43e9-baab-0d30a22bce90" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Cannot resize image /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'migration_context' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.objects.base [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Object Instance<44a2a895-06fc-43e9-baab-0d30a22bce90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG os_vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ca716a-b3, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28ca716a-b3, col_values=(('external_ids', {'iface-id': '28ca716a-b39a-4923-8261-36a8a99899cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ea:8a', 'vm-uuid': '44a2a895-06fc-43e9-baab-0d30a22bce90'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:43:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:23 user nova-compute[72954]: INFO os_vif [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:43:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:25 user nova-compute[72954]: WARNING nova.compute.manager [req-904166f1-482f-4fa5-970e-e293fe45750e req-dfe755b2-2f08-449b-be76-293bf482f1ee service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state powering-on.
Sep 04 23:43:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:27 user nova-compute[72954]: WARNING nova.compute.manager [req-dbfc68d9-1413-4429-8624-eca52059500d req-0b7517e0-3a24-4ddc-9153-fd23ed8f9bd5 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state stopped and task_state powering-on.
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871007.219978, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:43:27 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Resumed (Lifecycle Event)
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:43:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance rebooted successfully.
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a9ecf7e8-e15c-4434-9418-ecaaf2941984 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:43:27 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] During sync_power_state the instance has a pending task (powering-on). Skip.
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871007.2216601, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:43:27 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Started (Lifecycle Event)
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:43:27 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] During sync_power_state the instance has a pending task (powering-on). Skip.
Sep 04 23:43:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAVhQOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:43:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:43:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:43:27 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[111538e4-a352-4194-b5c3-88f085cd3284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:43:27 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf612bc-0b55-4f14-bd32-3e3d449cdfc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5] added
Sep 04 23:43:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6a3dd-39ff-4526-bee7-2c1a285c4f58]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593d1f9-3760-49bd-94c9-a1d4ef631afa]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAVhQOEt {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAVhQOEt" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616a6ba-ed8b-425f-bede-cf9b681c0973]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAVhQOEt'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[210373cc-18e2-48ad-9ff0-4bfb109cf393]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f454353-5a1a-4e0e-a2ed-ce68e2d7f7e4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:27 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:43:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4177939-a6c2-4ab8-ac3a-06d2d91377c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260]
Sep 04 23:43:28 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260] successful.
Sep 04 23:43:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a347069-9ec0-4e71-b5ce-cd23e6bc8c77]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26a8b2-779c-4b11-a3ba-d34f2f49e121]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:28 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:28 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08221f95-318e-41c9-a33e-b89d8b03e213]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAVhQOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:43:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23462656263623935', 'path': '/dev/sdf'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462656263623935', 'path': '/dev/sdf'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:43:29 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:43:29 user nova-compute[72954]:   <source dev="/dev/sdf"/>
Sep 04 23:43:29 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:43:29 user nova-compute[72954]:   <serial>4d139c8a-9762-4d69-96a0-01e285ca96f5</serial>
Sep 04 23:43:29 user nova-compute[72954]: </disk>
Sep 04 23:43:29 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] No VIF found with MAC fa:16:3e:7f:54:08, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:43:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-16256eea-3867-469c-a027-be56b61cb1e7 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.265s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing instance network info cache due to event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updated VIF entry in instance network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a606c067-fb08-4fd7-9763-9af15ac46c7b req-2505ec6b-e841-4212-8eca-45ddeaf6e207 service nova] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:34 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693870999.6567583, b74564bb-948a-43be-81b7-8504f4dc023a => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:43:34 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] VM Stopped (Lifecycle Event)
Sep 04 23:43:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6beff292-1889-449a-a6d6-b2dd9b37d7d8 None None] [instance: b74564bb-948a-43be-81b7-8504f4dc023a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing instance network info cache due to event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updated VIF entry in instance network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d2358c30-1f31-4b26-8450-99ff818fb29f req-69c82994-7258-4efa-a1b4-ef55161e0e9f service nova] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:35 user nova-compute[72954]: INFO nova.compute.manager [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Rebooting instance
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:38 user nova-compute[72954]: WARNING nova.compute.manager [req-c6e134ad-3a41-40bf-a89b-6798fb9ea524 req-5f8df8ba-43f1-4896-a803-81ff868eb42c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state active and task_state reboot_started.
Sep 04 23:43:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance shutdown successfully.
Sep 04 23:43:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:40 user nova-compute[72954]: WARNING nova.compute.manager [req-3d852d6f-52bd-4006-be0d-fcf0ca97bb02 req-b4c006f1-659d-491f-a520-f917780a4070 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state active and task_state reboot_started.
Sep 04 23:43:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:42 user nova-compute[72954]: WARNING nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state active and task_state reboot_started.
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:42 user nova-compute[72954]: WARNING nova.compute.manager [req-2ce68e92-7a4d-4d66-9871-97fb52a7c891 req-9b8180b4-11b4-4056-9080-8b92c6c1c9f3 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state active and task_state reboot_started.
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Removed pending event for ed91c1df-b7fe-4289-9e55-2c5e75e55e35 due to event {{(pid=72954) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871022.849187, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:43:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] VM Resumed (Lifecycle Event)
Sep 04 23:43:42 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance running successfully.
Sep 04 23:43:42 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance soft rebooted successfully.
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:43:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] During sync_power_state the instance has a pending task (reboot_started). Skip.
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871022.8505325, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:43:42 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] VM Started (Lifecycle Event)
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1cdfc29b-f2a5-4d13-9721-4df0c7cf400a tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.433s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing instance network info cache due to event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:43 user nova-compute[72954]: INFO nova.compute.manager [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Detaching volume a3a5a17a-c812-4c8b-97b8-4744975c5fff
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updated VIF entry in instance network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1e915170-57c0-4cbe-a50b-c88599d1b403 req-a1c278c1-bfe0-4fee-9173-d2f6674ddefc service nova] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:43 user nova-compute[72954]: INFO nova.virt.block_device [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Attempting to driver detach volume a3a5a17a-c812-4c8b-97b8-4744975c5fff from mountpoint /dev/vdb
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Attempting to detach device vdb from instance c88b8e02-ab4d-4c55-8e32-d61e8674121c from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:43:43 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:43:43 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:43:43 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:43:43 user nova-compute[72954]:   <serial>a3a5a17a-c812-4c8b-97b8-4744975c5fff</serial>
Sep 04 23:43:43 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:43:43 user nova-compute[72954]: </disk>
Sep 04 23:43:43 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:43:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully detached device vdb from instance c88b8e02-ab4d-4c55-8e32-d61e8674121c from the persistent domain config.
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c88b8e02-ab4d-4c55-8e32-d61e8674121c from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:43:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:43:43 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:43:43 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:43:43 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:43:43 user nova-compute[72954]:   <serial>a3a5a17a-c812-4c8b-97b8-4744975c5fff</serial>
Sep 04 23:43:43 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:43:43 user nova-compute[72954]: </disk>
Sep 04 23:43:43 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871024.3863385, c88b8e02-ab4d-4c55-8e32-d61e8674121c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:43:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully detached device vdb from instance c88b8e02-ab4d-4c55-8e32-d61e8674121c from the live domain config.
Sep 04 23:43:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihsFMHyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:43:44 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[870aabfb-5532-477e-97db-e2bea502df97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b99489-c612-42d4-9147-a0efe27b2e8b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:44 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183af370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d879f-1bb9-401a-8d99-0cdf4db95851]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8e3751-7552-4aa7-b665-b9125748b034]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a06da-ba7f-4ec5-a2e7-975e1cbf394c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[110cb9ae-f83a-4f3c-8ffd-cc4dad88ad95]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ff3f61-7572-4540-af8e-0715a175c5b4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[90248456-06e8-43dd-b8a3-d9dc21ad624e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260]
Sep 04 23:43:44 user nova-compute[72954]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff, portal: 172.16.0.220,3260] successful.
Sep 04 23:43:44 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a5a17a-c812-4c8b-97b8-4744975c5fff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.191s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5939177e-d880-4b4e-818f-4e3eb4cfb0db]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] <== disconnect_volume: return (497ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:43:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing instance network info cache due to event network-changed-b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] Acquiring lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] Acquired lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Refreshing network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.objects.instance [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'flavor' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updated VIF entry in instance network info cache for port b2eaacb4-91c4-4585-927e-80930137fe18. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG nova.network.neutron [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [{"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-98b99047-4bcb-4596-be42-167e8f20556d req-ccfc4611-b1e1-4cc1-ba5b-285195262dde service nova] Releasing lock "refresh_cache-c88b8e02-ab4d-4c55-8e32-d61e8674121c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-76ea97b9-a196-46ef-b722-ebf967b61dc7 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.104s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-changed-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing instance network info cache due to event network-changed-cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Refreshing network info cache for port cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated VIF entry in instance network info cache for port cbea434f-2c70-48bf-a272-430d03d91514. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-efd069a8-6fff-452c-b81b-6667ac318edf req-4b0632dd-ecad-4b5d-a5eb-396225d7db35 service nova] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Stashing vm_state: active {{(pid=72954) _prep_resize /opt/stack/nova/nova/compute/manager.py:5598}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:43:52 user nova-compute[72954]: INFO nova.compute.claims [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Claim successful on node user
Sep 04 23:43:52 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating resource usage from migration d51bf397-cabe-42fe-b5d9-fb7545157211
Sep 04 23:43:52 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.427s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:52 user nova-compute[72954]: INFO nova.compute.manager [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Migrating
Sep 04 23:43:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-changed-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Refreshing instance network info cache due to event network-changed-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Refreshing network info cache for port 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Starting migrate_disk_and_power_off {{(pid=72954) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:53 user nova-compute[72954]: WARNING nova.compute.manager [req-7443fa20-c9f8-4228-9b1b-12a4cf96c4d9 req-3c59b9fc-1a0e-4a51-937f-f8bedf5e2b80 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state active and task_state resize_migrating.
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.network.neutron [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updated VIF entry in instance network info cache for port 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.network.neutron [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-96109efe-88ce-4946-8c0c-d7d76e5f6d81 req-de569738-736a-45e6-a0d0-94def354201c service nova] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance destroyed successfully.
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3562d996-12, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:54 user nova-compute[72954]: INFO os_vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12')
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:43:54 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384de7d-92c0-454f-b612-39e23494cbab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6fae8-a6f0-4c5a-8211-016f54e2da2e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:43:54 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:43:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130159120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d44368-32ee-4ab0-b541-4e45ee05f8d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8be0497-c0ac-43dd-8dac-90599d99f920]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[23406086-e1bb-4ae9-8347-df5480161c82]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1668b9e8-aabb-49e5-912b-eb04029a2f0b]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26433373064653666', '/dev/disk/by-id/scsi-1SCST_BIO929b898f-d370de6f79f7cb0c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_929b898f') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d2dd7b-ba77-4f62-8bcf-8cea9d7eacd7]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9208714-0ffa-4b68-8a91-cf528bc13c80]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2404fc49-6cbf-4dac-92bb-239f4b44f886]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]
Sep 04 23:43:54 user nova-compute[72954]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.
Sep 04 23:43:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[300edffc-4d7c-49b5-a9b0-667d19a29fdc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== disconnect_volume: return (323ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:43:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Port 3562d996-1212-4b5c-a48d-9f9dc4fa6f1b binding to destination host user is already ACTIVE {{(pid=72954) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:43:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:43:55 user nova-compute[72954]: WARNING nova.compute.manager [req-4322fa10-4c1b-42dc-bab8-ac0ea28f95d0 req-4973ec9f-9646-4f47-8fca-9ec9ac331064 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state active and task_state resize_migrated.
Sep 04 23:43:56 user nova-compute[72954]: DEBUG nova.network.neutron [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.utils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec09e2-705e-4ff8-a6ca-2d557da0f4f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[02043458-06ae-4bbc-a4ad-d7e57b7203e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f316a547-6948-44ee-8b7c-fb88917a4086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d19199d-f50c-4501-bb91-fc65f2e90d37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:43:56 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:43:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[92579358-fb61-44c4-9873-268a4179e970]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:43:56 user nova-compute[72954]: DEBUG os_brick.utils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:43:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871034.2001572, 2bab57e0-c079-4701-9d61-7dd1a050068c => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:09 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Stopped (Lifecycle Event)
Sep 04 23:44:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fd3f77e7-ca30-491c-8131-d2dd5700b8e0 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fd3f77e7-ca30-491c-8131-d2dd5700b8e0 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:44:09 user nova-compute[72954]: INFO nova.compute.manager [None req-fd3f77e7-ca30-491c-8131-d2dd5700b8e0 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:44:09 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:09 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:44:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Starting finish_migration {{(pid=72954) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance directory exists: not creating {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Sep 04 23:44:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Creating image(s)
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Ensure instance console log exists: /opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start _get_guest_xml network_info=[{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2bab57e0-c079-4701-9d61-7dd1a050068c', 'attached_at': '2023-09-04T23:44:11.000000', 'detached_at': '', 'volume_id': 'deec85db-8217-49dc-8137-2a7ef19a8cbf', 'serial': 'deec85db-8217-49dc-8137-2a7ef19a8cbf'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd2c784cf-52b6-4eb2-b06c-2b3249314f7e', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:44:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:44:11 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:44:11 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:44:11 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4aa63-9be9-4311-8f79-733e32c26514]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:44:11 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dffe5a-9f8e-4d33-8967-27989b528a14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf] added
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b35bec9-c49f-4448-b46e-947bdca6671b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f47e57-71e7-4484-9f7e-8ab9addce348]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZeOPTpB {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZeOPTpB" returned: 0 in 0.045s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27688846-9b27-4b56-a102-8fbed221e4c2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZeOPTpB'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2394d838-3a9c-406f-9397-78fd331a4077]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d71769-4860-4b13-9b97-9548f9b142c5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f66aa-2021-4be8-9034-a4f498fa00dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]
Sep 04 23:44:11 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1386c8cb-4294-4b4b-9110-14d47f3332e3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8334f7-c62d-4fe4-b22b-473fdd9924c8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:11 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:11 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[370bc9fa-9986-4210-927a-9b1c9635f8e8]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '26433373064653666', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373064653666', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:44:12 user nova-compute[72954]:   <uuid>2bab57e0-c079-4701-9d61-7dd1a050068c</uuid>
Sep 04 23:44:12 user nova-compute[72954]:   <name>instance-0000001d</name>
Sep 04 23:44:12 user nova-compute[72954]:   <memory>2097152</memory>
Sep 04 23:44:12 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:44:12 user nova-compute[72954]:   <metadata>
Sep 04 23:44:12 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:44:12 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:44:12 user nova-compute[72954]:       <nova:name>tempest-ServerActionsTestOtherA-server-915815952</nova:name>
Sep 04 23:44:12 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:44:11</nova:creationTime>
Sep 04 23:44:12 user nova-compute[72954]:       <nova:flavor name="m1.small">
Sep 04 23:44:12 user nova-compute[72954]:         <nova:memory>2048</nova:memory>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:disk>20</nova:disk>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:44:12 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:44:12 user nova-compute[72954]:       <nova:owner>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:user uuid="3694a9f4359a487db80ec71c526201be">tempest-ServerActionsTestOtherA-520106611-project-member</nova:user>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:project uuid="9c2f8d4f90e74533b0f0b96581c8bd5a">tempest-ServerActionsTestOtherA-520106611</nova:project>
Sep 04 23:44:12 user nova-compute[72954]:       </nova:owner>
Sep 04 23:44:12 user nova-compute[72954]:       <nova:ports>
Sep 04 23:44:12 user nova-compute[72954]:         <nova:port uuid="3562d996-1212-4b5c-a48d-9f9dc4fa6f1b">
Sep 04 23:44:12 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:44:12 user nova-compute[72954]:         </nova:port>
Sep 04 23:44:12 user nova-compute[72954]:       </nova:ports>
Sep 04 23:44:12 user nova-compute[72954]:     </nova:instance>
Sep 04 23:44:12 user nova-compute[72954]:   </metadata>
Sep 04 23:44:12 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:44:12 user nova-compute[72954]:     <system>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="serial">2bab57e0-c079-4701-9d61-7dd1a050068c</entry>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="uuid">2bab57e0-c079-4701-9d61-7dd1a050068c</entry>
Sep 04 23:44:12 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:44:12 user nova-compute[72954]:     </system>
Sep 04 23:44:12 user nova-compute[72954]:   </sysinfo>
Sep 04 23:44:12 user nova-compute[72954]:   <os>
Sep 04 23:44:12 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:44:12 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:44:12 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:44:12 user nova-compute[72954]:   </os>
Sep 04 23:44:12 user nova-compute[72954]:   <features>
Sep 04 23:44:12 user nova-compute[72954]:     <acpi/>
Sep 04 23:44:12 user nova-compute[72954]:     <apic/>
Sep 04 23:44:12 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:44:12 user nova-compute[72954]:   </features>
Sep 04 23:44:12 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:44:12 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:44:12 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:44:12 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:44:12 user nova-compute[72954]:   </clock>
Sep 04 23:44:12 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:44:12 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:44:12 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:44:12 user nova-compute[72954]:   </cpu>
Sep 04 23:44:12 user nova-compute[72954]:   <devices>
Sep 04 23:44:12 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:44:12 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:44:12 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 04 23:44:12 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:44:12 user nova-compute[72954]:       <serial>deec85db-8217-49dc-8137-2a7ef19a8cbf</serial>
Sep 04 23:44:12 user nova-compute[72954]:     </disk>
Sep 04 23:44:12 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:44:12 user nova-compute[72954]:       <mac address="fa:16:3e:d6:d5:41"/>
Sep 04 23:44:12 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:44:12 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:44:12 user nova-compute[72954]:       <target dev="tap3562d996-12"/>
Sep 04 23:44:12 user nova-compute[72954]:     </interface>
Sep 04 23:44:12 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:44:12 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c/console.log" append="off"/>
Sep 04 23:44:12 user nova-compute[72954]:     </serial>
Sep 04 23:44:12 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:44:12 user nova-compute[72954]:     <video>
Sep 04 23:44:12 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:44:12 user nova-compute[72954]:     </video>
Sep 04 23:44:12 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:44:12 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:44:12 user nova-compute[72954]:     </rng>
Sep 04 23:44:12 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:44:12 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:44:12 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:44:12 user nova-compute[72954]:     </memballoon>
Sep 04 23:44:12 user nova-compute[72954]:   </devices>
Sep 04 23:44:12 user nova-compute[72954]: </domain>
Sep 04 23:44:12 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-356622181-network", "vif_mac": "fa:16:3e:d6:d5:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG os_vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3562d996-12, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3562d996-12, col_values=(('external_ids', {'iface-id': '3562d996-1212-4b5c-a48d-9f9dc4fa6f1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:41', 'vm-uuid': '2bab57e0-c079-4701-9d61-7dd1a050068c'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:12 user nova-compute[72954]: INFO os_vif [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12')
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] No VIF found with MAC fa:16:3e:d6:d5:41, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:44:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:13 user nova-compute[72954]: INFO nova.compute.manager [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Terminating instance
Sep 04 23:44:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-f00777e2-c5c4-4fb1-8e3c-fb5335ccb382 req-3707b703-e082-474d-95df-e71d725081d4 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-unplugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.manager [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:14 user nova-compute[72954]: WARNING nova.compute.manager [req-e1be4a24-c344-41a9-b83b-2e3179d59faf req-152dc58f-19cc-4f96-868d-8ade476239f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state active and task_state resize_finish.
Sep 04 23:44:14 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:14 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=25.202903747558594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Instance destroyed successfully.
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lazy-loading 'resources' on Instance uuid 663bbb50-2a1f-426a-92ba-6e925db7824f {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1752440406',display_name='tempest-ServerActionsTestOtherB-server-1752440406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1752440406',id=20,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDDZDqvVK12dzFAf7X5bNE9UUaBSL2UqZbvmL4WQBmZj0ZEwRw4X2okWKy5aS2V3XIyH1oEgS1IVzflMWeav/B4HXKB7oynIWZ3ayfsKgsaMZ+yc7D1aeFwwzZ9EtTN0A==',key_name='tempest-keypair-96957332',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:41:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39f3ce2c11044ffd860d87380f4cca0b',ramdisk_id='',reservation_id='r-h8c40hya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1198156614',owner_user_name='tempest-ServerActionsTestOtherB-1198156614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ecac73ee2f44251a327642041bbd1b3',uuid=663bbb50-2a1f-426a-92ba-6e925db7824f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converting VIF {"id": "254899bf-9c89-46ea-8390-fed26be7c8cb", "address": "fa:16:3e:c9:89:d0", "network": {"id": "3e2d6510-057d-4cd5-bad0-7c0d0c912ea7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-559017708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39f3ce2c11044ffd860d87380f4cca0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254899bf-9c", "ovs_interfaceid": "254899bf-9c89-46ea-8390-fed26be7c8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG os_vif [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254899bf-9c, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:44:14 user nova-compute[72954]: INFO os_vif [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:89:d0,bridge_name='br-int',has_traffic_filtering=True,id=254899bf-9c89-46ea-8390-fed26be7c8cb,network=Network(3e2d6510-057d-4cd5-bad0-7c0d0c912ea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254899bf-9c')
Sep 04 23:44:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cENTrKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:44:14 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:44:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5be5ff-f134-4d30-80b2-f189004ffec5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Applying migration context for instance 2bab57e0-c079-4701-9d61-7dd1a050068c as it has an incoming, in-progress migration d51bf397-cabe-42fe-b5d9-fb7545157211. Migration status is post-migrating {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Sep 04 23:44:15 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating resource usage from migration d51bf397-cabe-42fe-b5d9-fb7545157211
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7850c-2c5d-4aa9-8c1b-ccd5d9ac2965]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:15 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1301411b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c88b8e02-ab4d-4c55-8e32-d61e8674121c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 663bbb50-2a1f-426a-92ba-6e925db7824f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Migration d51bf397-cabe-42fe-b5d9-fb7545157211 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f907778-ce01-48e4-8079-b8feafac1391]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f856ab-bc41-4e0f-a0b2-832ef8d6e42e]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbbdad3-656e-4b94-82c9-ab6830533723]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade9ad0-4501-4847-983a-eeab8694822f]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc1fe5-1df3-4595-8846-ce20e8505889]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d92b1a-f560-4c40-b62e-c40ad9f009bc]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260]
Sep 04 23:44:15 user nova-compute[72954]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6, portal: 172.16.0.220,3260] successful.
Sep 04 23:44:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:484be8f7-cc1d-4d8f-a135-4f5f54a82fb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[58243513-2185-4d40-bfc8-05e4024ca7e7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] <== disconnect_volume: return (359ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:44:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Deleting instance files /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_del
Sep 04 23:44:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Deletion of /opt/stack/data/nova/instances/663bbb50-2a1f-426a-92ba-6e925db7824f_del complete
Sep 04 23:44:15 user nova-compute[72954]: INFO nova.compute.manager [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Took 1.78 seconds to destroy the instance on the hypervisor.
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:44:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] Acquiring lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] No waiting events found dispatching network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:16 user nova-compute[72954]: WARNING nova.compute.manager [req-25a66f13-20f6-4328-9ff2-da85bc39156c req-992c4992-d05f-428d-954d-d815a6059dcc service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received unexpected event network-vif-plugged-254899bf-9c89-46ea-8390-fed26be7c8cb for instance with vm_state active and task_state deleting.
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:16 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Took 1.01 seconds to deallocate network for instance.
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:16 user nova-compute[72954]: WARNING nova.compute.manager [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state active and task_state resize_finish.
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-158aa2ee-88de-4251-b5c9-6ad6bfe4e370 req-93c9546a-bb9e-4434-ac63-a01f9b3ea3f2 service nova] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Received event network-vif-deleted-254899bf-9c89-46ea-8390-fed26be7c8cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871056.9073856, 2bab57e0-c079-4701-9d61-7dd1a050068c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Resumed (Lifecycle Event)
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:44:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance running successfully.
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Failed to set time: agent not configured {{(pid=72954) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ed107e54-e22a-4444-8a79-3d007ea2e1af tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] finish_migration finished successfully. {{(pid=72954) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:44:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:44:16 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871056.9106708, 2bab57e0-c079-4701-9d61-7dd1a050068c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Started (Lifecycle Event)
Sep 04 23:44:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:44:17 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Sep 04 23:44:17 user nova-compute[72954]: INFO nova.compute.manager [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Took 0.93 seconds to detach 1 volumes for instance.
Sep 04 23:44:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:44:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:44:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:17 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Deleted allocations for instance 663bbb50-2a1f-426a-92ba-6e925db7824f
Sep 04 23:44:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4589a8d0-b321-4a2b-955c-42468b3cad33 tempest-ServerActionsTestOtherB-1198156614 tempest-ServerActionsTestOtherB-1198156614-project-member] Lock "663bbb50-2a1f-426a-92ba-6e925db7824f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.319s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:23 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:44:23 user nova-compute[72954]: INFO nova.compute.claims [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Claim successful on node user
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:44:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.policy [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22815594f2334a5aa727b3aab115af7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c910f268091a4c1090fb8adc3942c928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:44:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Creating image(s)
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.235s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk 1073741824" returned: 0 in 0.056s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Successfully created port: 9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Cannot resize image /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Ensure instance console log exists: /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Successfully updated port: 9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-changed-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing instance network info cache due to event network-changed-9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:44:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance network_info: |[{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start _get_guest_xml network_info=[{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:44:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuGVgFqlIh8+IeKUWFcplbdBivrDYPQzPemw/oL4Rp+Sfl/aj2hhXsiqkRCSEpRKc5LQFlA1LzQuMGC7AzJHBmOTvv5GBnY3xV/4X1ozfX0qefSZFnFQcUvnyxRUXC13Q==',key_name='tempest-keypair-1273442277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_devices' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:44:26 user nova-compute[72954]:   <uuid>ea7bdfdb-4756-44cc-8303-c9333e801500</uuid>
Sep 04 23:44:26 user nova-compute[72954]:   <name>instance-0000001f</name>
Sep 04 23:44:26 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:44:26 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:44:26 user nova-compute[72954]:   <metadata>
Sep 04 23:44:26 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:44:26 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2111222641</nova:name>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:44:26</nova:creationTime>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:44:26 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:44:26 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:owner>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:user uuid="22815594f2334a5aa727b3aab115af7f">tempest-AttachVolumeShelveTestJSON-966339939-project-member</nova:user>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:project uuid="c910f268091a4c1090fb8adc3942c928">tempest-AttachVolumeShelveTestJSON-966339939</nova:project>
Sep 04 23:44:26 user nova-compute[72954]:       </nova:owner>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:44:26 user nova-compute[72954]:       <nova:ports>
Sep 04 23:44:26 user nova-compute[72954]:         <nova:port uuid="9b466066-4269-4d95-97ea-b349d70475bc">
Sep 04 23:44:26 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:44:26 user nova-compute[72954]:         </nova:port>
Sep 04 23:44:26 user nova-compute[72954]:       </nova:ports>
Sep 04 23:44:26 user nova-compute[72954]:     </nova:instance>
Sep 04 23:44:26 user nova-compute[72954]:   </metadata>
Sep 04 23:44:26 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:44:26 user nova-compute[72954]:     <system>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="serial">ea7bdfdb-4756-44cc-8303-c9333e801500</entry>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="uuid">ea7bdfdb-4756-44cc-8303-c9333e801500</entry>
Sep 04 23:44:26 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:44:26 user nova-compute[72954]:     </system>
Sep 04 23:44:26 user nova-compute[72954]:   </sysinfo>
Sep 04 23:44:26 user nova-compute[72954]:   <os>
Sep 04 23:44:26 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:44:26 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:44:26 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:44:26 user nova-compute[72954]:   </os>
Sep 04 23:44:26 user nova-compute[72954]:   <features>
Sep 04 23:44:26 user nova-compute[72954]:     <acpi/>
Sep 04 23:44:26 user nova-compute[72954]:     <apic/>
Sep 04 23:44:26 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:44:26 user nova-compute[72954]:   </features>
Sep 04 23:44:26 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:44:26 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:44:26 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:44:26 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:44:26 user nova-compute[72954]:   </clock>
Sep 04 23:44:26 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:44:26 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:44:26 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:44:26 user nova-compute[72954]:   </cpu>
Sep 04 23:44:26 user nova-compute[72954]:   <devices>
Sep 04 23:44:26 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:44:26 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:44:26 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk"/>
Sep 04 23:44:26 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:44:26 user nova-compute[72954]:     </disk>
Sep 04 23:44:26 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:44:26 user nova-compute[72954]:       <mac address="fa:16:3e:cf:b2:6d"/>
Sep 04 23:44:26 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:44:26 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:44:26 user nova-compute[72954]:       <target dev="tap9b466066-42"/>
Sep 04 23:44:26 user nova-compute[72954]:     </interface>
Sep 04 23:44:26 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:44:26 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/console.log" append="off"/>
Sep 04 23:44:26 user nova-compute[72954]:     </serial>
Sep 04 23:44:26 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:44:26 user nova-compute[72954]:     <video>
Sep 04 23:44:26 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:44:26 user nova-compute[72954]:     </video>
Sep 04 23:44:26 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:44:26 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:44:26 user nova-compute[72954]:     </rng>
Sep 04 23:44:26 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:44:26 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:44:26 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:44:26 user nova-compute[72954]:     </memballoon>
Sep 04 23:44:26 user nova-compute[72954]:   </devices>
Sep 04 23:44:26 user nova-compute[72954]: </domain>
Sep 04 23:44:26 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuGVgFqlIh8+IeKUWFcplbdBivrDYPQzPemw/oL4Rp+Sfl/aj2hhXsiqkRCSEpRKc5LQFlA1LzQuMGC7AzJHBmOTvv5GBnY3xV/4X1ozfX0qefSZFnFQcUvnyxRUXC13Q==',key_name='tempest-keypair-1273442277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:44:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG os_vif [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b466066-42, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b466066-42, col_values=(('external_ids', {'iface-id': '9b466066-4269-4d95-97ea-b349d70475bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:b2:6d', 'vm-uuid': 'ea7bdfdb-4756-44cc-8303-c9333e801500'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:26 user nova-compute[72954]: INFO os_vif [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42')
Sep 04 23:44:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No VIF found with MAC fa:16:3e:cf:b2:6d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updated VIF entry in instance network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG nova.network.neutron [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:44:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a7dd05e0-e66e-4574-a2d5-c52d0fbadd96 req-f2940909-a739-4949-b689-44ea5c97423a service nova] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:44:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:28 user nova-compute[72954]: WARNING nova.compute.manager [req-e5364f53-d1c2-485d-a6f7-d71d7ec0e933 req-779aab10-328b-4bdf-8849-82e6b43e7172 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state building and task_state spawning.
Sep 04 23:44:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:28 user nova-compute[72954]: INFO nova.compute.manager [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Detaching volume 50dfa82d-7805-4fe7-8691-08bee5b9f58d
Sep 04 23:44:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Attempting to driver detach volume 50dfa82d-7805-4fe7-8691-08bee5b9f58d from mountpoint /dev/vdb
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Attempting to detach device vdb from instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:44:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:44:28 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:44:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:44:28 user nova-compute[72954]:   <serial>50dfa82d-7805-4fe7-8691-08bee5b9f58d</serial>
Sep 04 23:44:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:44:28 user nova-compute[72954]: </disk>
Sep 04 23:44:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully detached device vdb from instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea from the persistent domain config.
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:44:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:44:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:44:28 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:44:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:44:28 user nova-compute[72954]:   <serial>50dfa82d-7805-4fe7-8691-08bee5b9f58d</serial>
Sep 04 23:44:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:44:28 user nova-compute[72954]: </disk>
Sep 04 23:44:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871069.1071885, f5cefe1d-e86a-41c1-b92c-52a02bc735ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:44:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully detached device vdb from instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea from the live domain config.
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxcKrmDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:44:29 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5f6d87-514c-44bb-b6d4-014428f8d7bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5798f-1cf8-4e2a-99b0-c55ee4260f04]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:29 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:29 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d (non-flash)
Sep 04 23:44:29 user nova-compute[72954]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:29 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11836acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3bf238-eeb3-471d-ba31-6d6a4b5dba62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1edfb9f-bc57-489a-bd99-cb3887b1a265]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da911f3-bc7a-44a2-b071-935a3539a423]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf1eb3-6a7f-4a04-8e6b-db712bab7021]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fdf0fa-ccf7-40af-add4-48caa01c1f35]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd5090c-5262-4f97-ace6-cd2c5c775d2e]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260]
Sep 04 23:44:29 user nova-compute[72954]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d, portal: 172.16.0.220,3260] successful.
Sep 04 23:44:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a405aa-c74d-4b5c-91fa-103266ff65e4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== disconnect_volume: return (295ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871054.8771818, 663bbb50-2a1f-426a-92ba-6e925db7824f => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:29 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] VM Stopped (Lifecycle Event)
Sep 04 23:44:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e426a0fd-de5f-47dd-b7fe-55d62f9d63d3 None None] [instance: 663bbb50-2a1f-426a-92ba-6e925db7824f] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871070.1541064, ea7bdfdb-4756-44cc-8303-c9333e801500 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Resumed (Lifecycle Event)
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance spawned successfully.
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:30 user nova-compute[72954]: WARNING nova.compute.manager [req-fa7256d6-8f4d-4036-8acf-19dca2394179 req-42c557b7-093f-4424-99df-45837ed722a7 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state building and task_state spawning.
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871070.1586149, ea7bdfdb-4756-44cc-8303-c9333e801500 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Started (Lifecycle Event)
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Took 5.70 seconds to spawn the instance on the hypervisor.
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Took 6.47 seconds to build instance.
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f20047e-fc7c-4302-8cec-1b7ad0825265 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.567s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1d6f2559-01da-40ab-bf13-0a48ada49624 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.933s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.830s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:30 user nova-compute[72954]: INFO nova.compute.manager [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Terminating instance
Sep 04 23:44:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Instance destroyed successfully.
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'resources' on Instance uuid f5cefe1d-e86a-41c1-b92c-52a02bc735ea {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1371233140',display_name='tempest-VolumesSnapshotTestJSON-instance-1371233140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1371233140',id=27,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrXIHTB0mzf0Oh9ZRcJYkjdjzART6zzLpBWLAUNZeD4X7h7PukvtH+SU8/JXY/+Rll4hXfpt+aJ07kHu5FzrRF84StRBFh/n18oGecZFeobGMBTgbtY9+neJa+Q3U40fw==',key_name='tempest-keypair-493684976',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-45ucs9mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:40:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=f5cefe1d-e86a-41c1-b92c-52a02bc735ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "address": "fa:16:3e:f4:df:95", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d486b4-89", "ovs_interfaceid": "d4d486b4-8913-47a3-95df-4cb4dce4747a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_vif [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d486b4-89, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:31 user nova-compute[72954]: INFO os_vif [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:df:95,bridge_name='br-int',has_traffic_filtering=True,id=d4d486b4-8913-47a3-95df-4cb4dce4747a,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d486b4-89')
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxcKrmDT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:44:31 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50dfa82d-7805-4fe7-8691-08bee5b9f58d', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1f88e-58f5-4a2f-a66b-aa5af545d49e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddfa6dd-6bd7-4aed-b67b-e29a12e51476]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:31 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:44:31 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:44:31 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183d2050>, {}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Disconnecting from: [] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== disconnect_volume: return (63ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:44:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Deleting instance files /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea_del
Sep 04 23:44:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Deletion of /opt/stack/data/nova/instances/f5cefe1d-e86a-41c1-b92c-52a02bc735ea_del complete
Sep 04 23:44:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:31 user nova-compute[72954]: INFO nova.compute.manager [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Took 0.93 seconds to destroy the instance on the hypervisor.
Sep 04 23:44:31 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:44:31 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:44:32 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Took 0.75 seconds to deallocate network for instance.
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-2000c69c-a0d2-4956-a567-1934b5f064b8 req-f822e4ad-e40e-4aec-86d7-41d02d33acab service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-deleted-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:32 user nova-compute[72954]: WARNING nova.volume.cinder [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Attachment fef6633e-5cb1-4a57-8295-748406013ad7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fef6633e-5cb1-4a57-8295-748406013ad7. (HTTP 404) (Request-ID: req-136d15b8-7466-4ea0-a0e8-3b998a5d85cf)
Sep 04 23:44:32 user nova-compute[72954]: INFO nova.compute.manager [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Took 0.02 seconds to detach 1 volumes for instance.
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-unplugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] No waiting events found dispatching network-vif-unplugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-unplugged-d4d486b4-8913-47a3-95df-4cb4dce4747a for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Acquiring lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] No waiting events found dispatching network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:32 user nova-compute[72954]: WARNING nova.compute.manager [req-c32f55a5-d19b-466c-8d0c-e89ad266ad22 req-e71b1044-12fb-4322-8365-1b712d26521c service nova] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Received unexpected event network-vif-plugged-d4d486b4-8913-47a3-95df-4cb4dce4747a for instance with vm_state active and task_state deleting.
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:32 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Deleted allocations for instance f5cefe1d-e86a-41c1-b92c-52a02bc735ea
Sep 04 23:44:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4e945c6c-56ee-42a4-9904-64c8ce67b939 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "f5cefe1d-e86a-41c1-b92c-52a02bc735ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:34 user nova-compute[72954]: INFO nova.compute.manager [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Terminating instance
Sep 04 23:44:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-737ae7fc-b770-4da4-9bbc-dbf188cff725 req-cb0ddaaa-5ef7-4030-ac3a-9a86cc50bfff service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-unplugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:44:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Instance destroyed successfully.
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.objects.instance [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid c88b8e02-ab4d-4c55-8e32-d61e8674121c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-436359465',display_name='tempest-ServerRescueNegativeTestJSON-server-436359465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-436359465',id=24,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU+3donveUiSkzIO5j0s3zuZeAeSf15n6hkRBW8qYDZ7MYb7k62h8LVfhyHdlafg0Ham4nmkKJCW8CSTZ4st9cFiWSwUhfRffy/8YBP6NH3TgSXUYxLDtRcUEpq1ShrdQ==',key_name='tempest-keypair-1968450403',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:40:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-mm7pnk05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c88b8e02-ab4d-4c55-8e32-d61e8674121c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "b2eaacb4-91c4-4585-927e-80930137fe18", "address": "fa:16:3e:ee:c4:e6", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2eaacb4-91", "ovs_interfaceid": "b2eaacb4-91c4-4585-927e-80930137fe18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG os_vif [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2eaacb4-91, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:35 user nova-compute[72954]: INFO os_vif [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:c4:e6,bridge_name='br-int',has_traffic_filtering=True,id=b2eaacb4-91c4-4585-927e-80930137fe18,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2eaacb4-91')
Sep 04 23:44:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Deleting instance files /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c_del
Sep 04 23:44:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Deletion of /opt/stack/data/nova/instances/c88b8e02-ab4d-4c55-8e32-d61e8674121c_del complete
Sep 04 23:44:35 user nova-compute[72954]: INFO nova.compute.manager [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Took 0.86 seconds to destroy the instance on the hypervisor.
Sep 04 23:44:35 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:44:35 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:44:36 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Took 1.26 seconds to deallocate network for instance.
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf139491-d7c6-4be6-a3e0-4d78a738f2fc req-48fe97b9-544e-4447-b704-466ee200b36c service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-deleted-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] Acquiring lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] No waiting events found dispatching network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:44:36 user nova-compute[72954]: WARNING nova.compute.manager [req-4991f21c-3fbf-4f39-894c-3df83e5d7050 req-42fc620d-1616-487d-b8b7-96a0b03dded6 service nova] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Received unexpected event network-vif-plugged-b2eaacb4-91c4-4585-927e-80930137fe18 for instance with vm_state deleted and task_state None.
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:36 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Deleted allocations for instance c88b8e02-ab4d-4c55-8e32-d61e8674121c
Sep 04 23:44:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-66afad5f-6d76-4508-bae5-6eb639266364 tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c88b8e02-ab4d-4c55-8e32-d61e8674121c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.681s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:44:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:46 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871071.2473128, f5cefe1d-e86a-41c1-b92c-52a02bc735ea => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:46 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] VM Stopped (Lifecycle Event)
Sep 04 23:44:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-49558d41-593a-486e-bec1-bc97d1907b4f None None] [instance: f5cefe1d-e86a-41c1-b92c-52a02bc735ea] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:50 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871075.0089343, c88b8e02-ab4d-4c55-8e32-d61e8674121c => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:44:50 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] VM Stopped (Lifecycle Event)
Sep 04 23:44:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3386aeea-6d53-48d3-8b31-053393cd69d9 None None] [instance: c88b8e02-ab4d-4c55-8e32-d61e8674121c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:44:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:44:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:45:09 user nova-compute[72954]: INFO nova.compute.claims [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Claim successful on node user
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:45:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.policy [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '536a0b82fb19498e8429269cc4857915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b393bd669d743a681aafa6875303a01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:45:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Creating image(s)
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "/opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "/opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "/opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk 1073741824" returned: 0 in 0.055s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Successfully created port: 623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Cannot resize image /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Ensure instance console log exists: /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:10 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Successfully updated port: 623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-changed-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.compute.manager [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Refreshing instance network info cache due to event network-changed-623f4a68-c81d-4e52-87ea-4593ab6b3074. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Instance network_info: |[{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.neutron [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Refreshing network info cache for port 623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Start _get_guest_xml network_info=[{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:45:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:45:11 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1297423734',display_name='tempest-SnapshotDataIntegrityTests-server-1297423734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1297423734',id=32,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihYcPIcSoAF9jj7TEAYOykpxzxiE2z+J2mcQELAYHwzAnqT4B9FX5eFWDGxRQxvRSN4LClJgZaeBD6IITujkl7lTwEvyWdAa6vJkMUb7b1xVtYeuxBAERnYXhSnoT54A==',key_name='tempest-keypair-110536965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b393bd669d743a681aafa6875303a01',ramdisk_id='',reservation_id='r-l5acardi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-225866483',owner_user_name='tempest-SnapshotDataIntegrityTests-225866483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:45:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='536a0b82fb19498e8429269cc4857915',uuid=29c1b984-b059-4a9c-8137-59391b5990bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converting VIF {"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'pci_devices' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:45:11 user nova-compute[72954]:   <uuid>29c1b984-b059-4a9c-8137-59391b5990bf</uuid>
Sep 04 23:45:11 user nova-compute[72954]:   <name>instance-00000020</name>
Sep 04 23:45:11 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:45:11 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:45:11 user nova-compute[72954]:   <metadata>
Sep 04 23:45:11 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:45:11 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1297423734</nova:name>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:45:11</nova:creationTime>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:45:11 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:45:11 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:owner>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:user uuid="536a0b82fb19498e8429269cc4857915">tempest-SnapshotDataIntegrityTests-225866483-project-member</nova:user>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:project uuid="0b393bd669d743a681aafa6875303a01">tempest-SnapshotDataIntegrityTests-225866483</nova:project>
Sep 04 23:45:11 user nova-compute[72954]:       </nova:owner>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:45:11 user nova-compute[72954]:       <nova:ports>
Sep 04 23:45:11 user nova-compute[72954]:         <nova:port uuid="623f4a68-c81d-4e52-87ea-4593ab6b3074">
Sep 04 23:45:11 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:45:11 user nova-compute[72954]:         </nova:port>
Sep 04 23:45:11 user nova-compute[72954]:       </nova:ports>
Sep 04 23:45:11 user nova-compute[72954]:     </nova:instance>
Sep 04 23:45:11 user nova-compute[72954]:   </metadata>
Sep 04 23:45:11 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:45:11 user nova-compute[72954]:     <system>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="serial">29c1b984-b059-4a9c-8137-59391b5990bf</entry>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="uuid">29c1b984-b059-4a9c-8137-59391b5990bf</entry>
Sep 04 23:45:11 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:45:11 user nova-compute[72954]:     </system>
Sep 04 23:45:11 user nova-compute[72954]:   </sysinfo>
Sep 04 23:45:11 user nova-compute[72954]:   <os>
Sep 04 23:45:11 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:45:11 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:45:11 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:45:11 user nova-compute[72954]:   </os>
Sep 04 23:45:11 user nova-compute[72954]:   <features>
Sep 04 23:45:11 user nova-compute[72954]:     <acpi/>
Sep 04 23:45:11 user nova-compute[72954]:     <apic/>
Sep 04 23:45:11 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:45:11 user nova-compute[72954]:   </features>
Sep 04 23:45:11 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:45:11 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:45:11 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:45:11 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:45:11 user nova-compute[72954]:   </clock>
Sep 04 23:45:11 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:45:11 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:45:11 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:45:11 user nova-compute[72954]:   </cpu>
Sep 04 23:45:11 user nova-compute[72954]:   <devices>
Sep 04 23:45:11 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:45:11 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:45:11 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk"/>
Sep 04 23:45:11 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:45:11 user nova-compute[72954]:     </disk>
Sep 04 23:45:11 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:45:11 user nova-compute[72954]:       <mac address="fa:16:3e:4c:76:3a"/>
Sep 04 23:45:11 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:45:11 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:45:11 user nova-compute[72954]:       <target dev="tap623f4a68-c8"/>
Sep 04 23:45:11 user nova-compute[72954]:     </interface>
Sep 04 23:45:11 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:45:11 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/console.log" append="off"/>
Sep 04 23:45:11 user nova-compute[72954]:     </serial>
Sep 04 23:45:11 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:45:11 user nova-compute[72954]:     <video>
Sep 04 23:45:11 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:45:11 user nova-compute[72954]:     </video>
Sep 04 23:45:11 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:45:11 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:45:11 user nova-compute[72954]:     </rng>
Sep 04 23:45:11 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:45:11 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:45:11 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:45:11 user nova-compute[72954]:     </memballoon>
Sep 04 23:45:11 user nova-compute[72954]:   </devices>
Sep 04 23:45:11 user nova-compute[72954]: </domain>
Sep 04 23:45:11 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1297423734',display_name='tempest-SnapshotDataIntegrityTests-server-1297423734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1297423734',id=32,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihYcPIcSoAF9jj7TEAYOykpxzxiE2z+J2mcQELAYHwzAnqT4B9FX5eFWDGxRQxvRSN4LClJgZaeBD6IITujkl7lTwEvyWdAa6vJkMUb7b1xVtYeuxBAERnYXhSnoT54A==',key_name='tempest-keypair-110536965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b393bd669d743a681aafa6875303a01',ramdisk_id='',reservation_id='r-l5acardi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-225866483',owner_user_name='tempest-SnapshotDataIntegrityTests-225866483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:45:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='536a0b82fb19498e8429269cc4857915',uuid=29c1b984-b059-4a9c-8137-59391b5990bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converting VIF {"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG os_vif [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap623f4a68-c8, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap623f4a68-c8, col_values=(('external_ids', {'iface-id': '623f4a68-c81d-4e52-87ea-4593ab6b3074', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:76:3a', 'vm-uuid': '29c1b984-b059-4a9c-8137-59391b5990bf'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:45:11 user nova-compute[72954]: INFO os_vif [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8')
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No VIF found with MAC fa:16:3e:4c:76:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:11 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updated VIF entry in instance network info cache for port 623f4a68-c81d-4e52-87ea-4593ab6b3074. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-89ca7ae6-0c1a-4a1a-8689-a3c6c46294c8 req-3f0fbc32-429e-4c21-9528-f7005177f05e service nova] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:12 user nova-compute[72954]: INFO nova.compute.manager [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Terminating instance
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-5733f630-94cd-45b2-ad31-05ae8b2264c6 req-05d95443-bae2-47d2-8e18-d10ea35807a4 service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-unplugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] No waiting events found dispatching network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:13 user nova-compute[72954]: WARNING nova.compute.manager [req-8ea1c1ce-06fe-47ff-9a5b-dc8fb17a2651 req-5757a58e-bde7-4e33-a23e-49663c823ef2 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received unexpected event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 for instance with vm_state building and task_state spawning.
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Instance destroyed successfully.
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.objects.instance [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'resources' on Instance uuid 44a2a895-06fc-43e9-baab-0d30a22bce90 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2106306957',display_name='tempest-AttachVolumeTestJSON-server-2106306957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2106306957',id=21,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMTf2R5PGy02EGl7BAORtOSpqIgMC4s7OKPsiiF9FBKO4zFn7gyyqqs923stsb0702JZ1mObvMLRsidWRDubl0wGHfkvF6mCnGDFcgR7BWj7sRPE/cz6whVDORs6RokhA==',key_name='tempest-keypair-736741883',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-d32u6vc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:43:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=44a2a895-06fc-43e9-baab-0d30a22bce90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "28ca716a-b39a-4923-8261-36a8a99899cf", "address": "fa:16:3e:d0:ea:8a", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ca716a-b3", "ovs_interfaceid": "28ca716a-b39a-4923-8261-36a8a99899cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG os_vif [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ca716a-b3, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:45:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:13 user nova-compute[72954]: INFO os_vif [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ea:8a,bridge_name='br-int',has_traffic_filtering=True,id=28ca716a-b39a-4923-8261-36a8a99899cf,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ca716a-b3')
Sep 04 23:45:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Deleting instance files /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90_del
Sep 04 23:45:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Deletion of /opt/stack/data/nova/instances/44a2a895-06fc-43e9-baab-0d30a22bce90_del complete
Sep 04 23:45:14 user nova-compute[72954]: INFO nova.compute.manager [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Took 1.02 seconds to destroy the instance on the hypervisor.
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871115.6373084, 29c1b984-b059-4a9c-8137-59391b5990bf => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] VM Resumed (Lifecycle Event)
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] Acquiring lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] No waiting events found dispatching network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:15 user nova-compute[72954]: WARNING nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received unexpected event network-vif-plugged-28ca716a-b39a-4923-8261-36a8a99899cf for instance with vm_state active and task_state deleting.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Received event network-vif-deleted-28ca716a-b39a-4923-8261-36a8a99899cf {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Neutron deleted interface 28ca716a-b39a-4923-8261-36a8a99899cf; detaching it from the instance and deleting it from the info cache
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] No waiting events found dispatching network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:15 user nova-compute[72954]: WARNING nova.compute.manager [req-f9d1d2b1-9a8f-490d-aca5-ca976f809125 req-91f054dd-6306-457c-a41d-dc3919a78fde service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received unexpected event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 for instance with vm_state building and task_state spawning.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Instance spawned successfully.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-2807dc3f-fd45-4c5b-aa6e-029547e7ee7d req-e5168fbe-eac4-49b2-aec2-73986a800f3f service nova] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Detach interface failed, port_id=28ca716a-b39a-4923-8261-36a8a99899cf, reason: Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Took 1.94 seconds to deallocate network for instance.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:45:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:45:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7482MB free_disk=25.253097534179688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:45:15 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871115.637516, 29c1b984-b059-4a9c-8137-59391b5990bf => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:45:15 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] VM Started (Lifecycle Event)
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:45:16 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:45:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:16 user nova-compute[72954]: INFO nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Took 6.26 seconds to spawn the instance on the hypervisor.
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Applying migration context for instance 2bab57e0-c079-4701-9d61-7dd1a050068c as it has an incoming, in-progress migration d51bf397-cabe-42fe-b5d9-fb7545157211. Migration status is finished {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Sep 04 23:45:16 user nova-compute[72954]: INFO nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating resource usage from migration d51bf397-cabe-42fe-b5d9-fb7545157211
Sep 04 23:45:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance c15ab7fd-25fc-42ba-a451-c91cfe60c884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 44a2a895-06fc-43e9-baab-0d30a22bce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Migration d51bf397-cabe-42fe-b5d9-fb7545157211 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ea7bdfdb-4756-44cc-8303-c9333e801500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:45:16 user nova-compute[72954]: INFO nova.compute.manager [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Took 6.98 seconds to build instance.
Sep 04 23:45:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd76af19-c20f-49b8-8a51-700216444a8a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.072s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.638s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:45:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:45:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:45:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:45:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:17 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Deleted allocations for instance 44a2a895-06fc-43e9-baab-0d30a22bce90
Sep 04 23:45:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-06e898d4-371e-4575-89ed-c90c3d4432b4 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "44a2a895-06fc-43e9-baab-0d30a22bce90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.239s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:45:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:45:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:45:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [{"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-09afe965-5ce9-43b6-83f7-f0e378ef33e9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing instance network info cache due to event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updated VIF entry in instance network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32dac432-47cc-4edf-8be7-1d25a9151cfd req-10f706be-b80b-4fb1-a852-b757db2bd654 service nova] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing instance network info cache due to event network-changed-ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] Acquiring lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] Acquired lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Refreshing network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:28 user nova-compute[72954]: INFO nova.compute.manager [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Detaching volume 4d139c8a-9762-4d69-96a0-01e285ca96f5
Sep 04 23:45:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Attempting to driver detach volume 4d139c8a-9762-4d69-96a0-01e285ca96f5 from mountpoint /dev/vdb
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Attempting to detach device vdb from instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:45:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:45:28 user nova-compute[72954]:   <source dev="/dev/sdf"/>
Sep 04 23:45:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:45:28 user nova-compute[72954]:   <serial>4d139c8a-9762-4d69-96a0-01e285ca96f5</serial>
Sep 04 23:45:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:45:28 user nova-compute[72954]: </disk>
Sep 04 23:45:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:45:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully detached device vdb from instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 from the persistent domain config.
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:45:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:45:28 user nova-compute[72954]:   <source dev="/dev/sdf"/>
Sep 04 23:45:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:45:28 user nova-compute[72954]:   <serial>4d139c8a-9762-4d69-96a0-01e285ca96f5</serial>
Sep 04 23:45:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:45:28 user nova-compute[72954]: </disk>
Sep 04 23:45:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871113.824452, 44a2a895-06fc-43e9-baab-0d30a22bce90 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:45:28 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] VM Stopped (Lifecycle Event)
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updated VIF entry in instance network info cache for port ce7d1d21-00e9-4605-9bbb-17a509c6177b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [{"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-55ff2287-f2e3-460d-9429-401eb1f519cc None None] [instance: 44a2a895-06fc-43e9-baab-0d30a22bce90] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4e4a9b2-a296-47b6-b9c3-252404daba6c req-5bb85c8c-b161-439f-b28b-e0ece695032c service nova] Releasing lock "refresh_cache-ed91c1df-b7fe-4289-9e55-2c5e75e55e35" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871129.15804, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:45:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully detached device vdb from instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 from the live domain config.
Sep 04 23:45:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAVhQOEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:45:29 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b77de96-255a-4384-ac17-9b4d89daf656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08f6bf-f066-40d4-bf9e-4cadb8acdd0f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:45:29 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:45:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 (non-flash)
Sep 04 23:45:29 user nova-compute[72954]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:45:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183f0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5'): ({'sdf'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Removing single pathed devices sdf {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[decce72e-d862-4b4e-b65b-fa9561a5544b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe7aeab-7d45-4758-a89c-7f8ba9fb3db2]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Flushing IO for device /dev/sdf {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafeb9d1-6219-4f5d-83d7-488ba861e4ad]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1813813b-2d8e-4e2a-af11-65fa05776e07]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] SCSI volumes sdf have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e0456-f243-40ac-bb19-1ee26929b8e1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa078824-f584-4c7e-8f24-5ce84ecd52c7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260]
Sep 04 23:45:29 user nova-compute[72954]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5, portal: 172.16.0.220,3260] successful.
Sep 04 23:45:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d139c8a-9762-4d69-96a0-01e285ca96f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a35c0d-f82f-410c-89d5-5b040b299421]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] <== disconnect_volume: return (328ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:45:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:45:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'flavor' on Instance uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5d0d70bc-3d46-408a-859d-db28f6826f65 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.971s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:45:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Going to confirm migration 2 {{(pid=72954) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4757}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:45:42 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'info_cache' on Instance uuid 2bab57e0-c079-4701-9d61-7dd1a050068c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'migration_context' on Instance uuid 2bab57e0-c079-4701-9d61-7dd1a050068c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.objects.base [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Object Instance<2bab57e0-c079-4701-9d61-7dd1a050068c> lazy-loaded attributes: info_cache,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:43 user nova-compute[72954]: INFO nova.compute.manager [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Terminating instance
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.501s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:43 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Deleted allocation for migration d51bf397-cabe-42fe-b5d9-fb7545157211
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-95594d75-1f36-45f1-865d-0e6513e2bd7a req-03e3ddc4-48db-42cc-af56-cb965a88fd89 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-unplugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:45:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2a4c34e8-4c5e-48c6-b84a-812ec35abaa4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.545s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Instance destroyed successfully.
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid c15ab7fd-25fc-42ba-a451-c91cfe60c884 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1384140502',display_name='tempest-ServerRescueNegativeTestJSON-server-1384140502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1384140502',id=2,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:31:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-f7i1yg3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:31:04Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=c15ab7fd-25fc-42ba-a451-c91cfe60c884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "address": "fa:16:3e:4f:48:56", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec776aa-6f", "ovs_interfaceid": "2ec776aa-6f1e-46ee-b753-ae93df0a91d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG os_vif [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ec776aa-6f, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:44 user nova-compute[72954]: INFO os_vif [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:48:56,bridge_name='br-int',has_traffic_filtering=True,id=2ec776aa-6f1e-46ee-b753-ae93df0a91d3,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec776aa-6f')
Sep 04 23:45:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Deleting instance files /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884_del
Sep 04 23:45:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Deletion of /opt/stack/data/nova/instances/c15ab7fd-25fc-42ba-a451-c91cfe60c884_del complete
Sep 04 23:45:44 user nova-compute[72954]: INFO nova.compute.manager [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Took 0.91 seconds to destroy the instance on the hypervisor.
Sep 04 23:45:44 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:45:44 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:45:45 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Took 0.70 seconds to deallocate network for instance.
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-26795c53-5499-4ebe-b975-33e6c45dfd52 req-89d863d2-70c7-4deb-96a0-9f201c8c5ec8 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-deleted-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:45 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Deleted allocations for instance c15ab7fd-25fc-42ba-a451-c91cfe60c884
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c766cec-1ce8-487c-8509-c71eed4fbfbe tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] Acquiring lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] Lock "c15ab7fd-25fc-42ba-a451-c91cfe60c884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:45:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] No waiting events found dispatching network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:45:45 user nova-compute[72954]: WARNING nova.compute.manager [req-6e8742ea-3573-4539-8f06-0718b804ae92 req-5d0c31ba-1770-47ca-8b60-0076c131d2a4 service nova] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Received unexpected event network-vif-plugged-2ec776aa-6f1e-46ee-b753-ae93df0a91d3 for instance with vm_state deleted and task_state None.
Sep 04 23:45:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:45:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:45:59 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871144.4522557, c15ab7fd-25fc-42ba-a451-c91cfe60c884 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:45:59 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] VM Stopped (Lifecycle Event)
Sep 04 23:45:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e3401007-c5b1-42e8-8256-6ba5e2b53a6a None None] [instance: c15ab7fd-25fc-42ba-a451-c91cfe60c884] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:45:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:04 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:46:04 user nova-compute[72954]: INFO nova.compute.claims [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Claim successful on node user
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:46:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.policy [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa79abd0fdf546209e803129a014193e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed107bda33f4121b93cdae99b20b44b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:46:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Creating image(s)
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "/opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "/opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Successfully created port: 465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk 1073741824" returned: 0 in 0.049s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:06 user nova-compute[72954]: WARNING nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid d57a3389-b5ab-4dc3-8729-6e87085a4e54 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 6605195e-6cd2-4fe7-9fb0-786a25557498 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 2bab57e0-c079-4701-9d61-7dd1a050068c {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.196s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Cannot resize image /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Ensure instance console log exists: /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:46:06 user nova-compute[72954]: INFO nova.compute.claims [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Claim successful on node user
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Successfully updated port: 465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquired lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-changed-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Refreshing instance network info cache due to event network-changed-465d9522-f495-4581-8eff-4b39422477e2. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] Acquiring lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:06 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.neutron [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updating instance_info_cache with network_info: [{"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Releasing lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Instance network_info: |[{"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] Acquired lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Refreshing network info cache for port 465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Start _get_guest_xml network_info=[{"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:46:07 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:07 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-729409747',display_name='tempest-VolumesSnapshotTestJSON-instance-729409747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-729409747',id=33,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnW9vVDa4QUli4+4rGWpU5u70C1/VoV4LV1uZBtpm9wr+EClMgh3mkhgbcu6MSU65180vtyX0n1GjFADN1Jethr/NxOSX3EIS/GPPRZ6fRkLsLo5alPWv/+TDKg3JHL3A==',key_name='tempest-keypair-660078741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-xondjyhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.objects.instance [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'pci_devices' on Instance uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:46:07 user nova-compute[72954]:   <uuid>ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131</uuid>
Sep 04 23:46:07 user nova-compute[72954]:   <name>instance-00000021</name>
Sep 04 23:46:07 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:46:07 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:46:07 user nova-compute[72954]:   <metadata>
Sep 04 23:46:07 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:46:07 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-729409747</nova:name>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:46:07</nova:creationTime>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:46:07 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:46:07 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:owner>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:user uuid="fa79abd0fdf546209e803129a014193e">tempest-VolumesSnapshotTestJSON-104452992-project-member</nova:user>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:project uuid="2ed107bda33f4121b93cdae99b20b44b">tempest-VolumesSnapshotTestJSON-104452992</nova:project>
Sep 04 23:46:07 user nova-compute[72954]:       </nova:owner>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:46:07 user nova-compute[72954]:       <nova:ports>
Sep 04 23:46:07 user nova-compute[72954]:         <nova:port uuid="465d9522-f495-4581-8eff-4b39422477e2">
Sep 04 23:46:07 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:46:07 user nova-compute[72954]:         </nova:port>
Sep 04 23:46:07 user nova-compute[72954]:       </nova:ports>
Sep 04 23:46:07 user nova-compute[72954]:     </nova:instance>
Sep 04 23:46:07 user nova-compute[72954]:   </metadata>
Sep 04 23:46:07 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:46:07 user nova-compute[72954]:     <system>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="serial">ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131</entry>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="uuid">ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131</entry>
Sep 04 23:46:07 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:46:07 user nova-compute[72954]:     </system>
Sep 04 23:46:07 user nova-compute[72954]:   </sysinfo>
Sep 04 23:46:07 user nova-compute[72954]:   <os>
Sep 04 23:46:07 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:46:07 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:46:07 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:46:07 user nova-compute[72954]:   </os>
Sep 04 23:46:07 user nova-compute[72954]:   <features>
Sep 04 23:46:07 user nova-compute[72954]:     <acpi/>
Sep 04 23:46:07 user nova-compute[72954]:     <apic/>
Sep 04 23:46:07 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:46:07 user nova-compute[72954]:   </features>
Sep 04 23:46:07 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:46:07 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:46:07 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:46:07 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:46:07 user nova-compute[72954]:   </clock>
Sep 04 23:46:07 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:46:07 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:46:07 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:46:07 user nova-compute[72954]:   </cpu>
Sep 04 23:46:07 user nova-compute[72954]:   <devices>
Sep 04 23:46:07 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:46:07 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:46:07 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk"/>
Sep 04 23:46:07 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:46:07 user nova-compute[72954]:     </disk>
Sep 04 23:46:07 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:46:07 user nova-compute[72954]:       <mac address="fa:16:3e:fd:bb:ee"/>
Sep 04 23:46:07 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:46:07 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:46:07 user nova-compute[72954]:       <target dev="tap465d9522-f4"/>
Sep 04 23:46:07 user nova-compute[72954]:     </interface>
Sep 04 23:46:07 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:46:07 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/console.log" append="off"/>
Sep 04 23:46:07 user nova-compute[72954]:     </serial>
Sep 04 23:46:07 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:46:07 user nova-compute[72954]:     <video>
Sep 04 23:46:07 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:46:07 user nova-compute[72954]:     </video>
Sep 04 23:46:07 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:46:07 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:46:07 user nova-compute[72954]:     </rng>
Sep 04 23:46:07 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:46:07 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:46:07 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:46:07 user nova-compute[72954]:     </memballoon>
Sep 04 23:46:07 user nova-compute[72954]:   </devices>
Sep 04 23:46:07 user nova-compute[72954]: </domain>
Sep 04 23:46:07 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-729409747',display_name='tempest-VolumesSnapshotTestJSON-instance-729409747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-729409747',id=33,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnW9vVDa4QUli4+4rGWpU5u70C1/VoV4LV1uZBtpm9wr+EClMgh3mkhgbcu6MSU65180vtyX0n1GjFADN1Jethr/NxOSX3EIS/GPPRZ6fRkLsLo5alPWv/+TDKg3JHL3A==',key_name='tempest-keypair-660078741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-xondjyhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG os_vif [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465d9522-f4, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap465d9522-f4, col_values=(('external_ids', {'iface-id': '465d9522-f495-4581-8eff-4b39422477e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:bb:ee', 'vm-uuid': 'ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:07 user nova-compute[72954]: INFO os_vif [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4')
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No VIF found with MAC fa:16:3e:fd:bb:ee, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.policy [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2c3ec932cc64d98a8b1b6c10dd6f432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9857524a888d4d9f9d3e48341500411a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:46:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Creating image(s)
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "/opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "/opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "/opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updated VIF entry in instance network info cache for port 465d9522-f495-4581-8eff-4b39422477e2. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updating instance_info_cache with network_info: [{"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cf3f1564-8a1b-49a9-b10f-ad380643c1c5 req-b0d157c2-3c96-4589-967c-e8351d602214 service nova] Releasing lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk 1073741824" returned: 0 in 0.060s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Successfully created port: bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Cannot resize image /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Ensure instance console log exists: /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Successfully updated port: bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquired lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] No waiting events found dispatching network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:08 user nova-compute[72954]: WARNING nova.compute.manager [req-6134f3fd-ec8c-470b-adba-9a308ff26e99 req-b55e9e30-20ab-4b04-9567-95072500bf67 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received unexpected event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 for instance with vm_state building and task_state spawning.
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-changed-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Refreshing instance network info cache due to event network-changed-bbe133bb-92bc-4c89-9dff-c1d034430830. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:46:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] Acquiring lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.neutron [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating instance_info_cache with network_info: [{"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Releasing lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Instance network_info: |[{"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] Acquired lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Refreshing network info cache for port bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Start _get_guest_xml network_info=[{"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:46:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:09 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1860626477',display_name='tempest-AttachVolumeTestJSON-server-1860626477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1860626477',id=34,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFRNcLx2/F732z375QS/ZuNgWNTwiG4nZq8Xhyg+B9tmI4lbhwUbRSnReglz9H/AjMRx+ojRP7i/hzH/P60BJc/lFI9dV+YJOcBIXF9C9eAq/0nHsHRx/cqJtupPOEEbQ==',key_name='tempest-keypair-1522777488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-ke30losl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=75e269bc-f74f-4233-a59a-729b927f1652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'pci_devices' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:46:09 user nova-compute[72954]:   <uuid>75e269bc-f74f-4233-a59a-729b927f1652</uuid>
Sep 04 23:46:09 user nova-compute[72954]:   <name>instance-00000022</name>
Sep 04 23:46:09 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:46:09 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:46:09 user nova-compute[72954]:   <metadata>
Sep 04 23:46:09 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:46:09 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeTestJSON-server-1860626477</nova:name>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:46:09</nova:creationTime>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:46:09 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:46:09 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:owner>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:user uuid="d2c3ec932cc64d98a8b1b6c10dd6f432">tempest-AttachVolumeTestJSON-79448822-project-member</nova:user>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:project uuid="9857524a888d4d9f9d3e48341500411a">tempest-AttachVolumeTestJSON-79448822</nova:project>
Sep 04 23:46:09 user nova-compute[72954]:       </nova:owner>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:46:09 user nova-compute[72954]:       <nova:ports>
Sep 04 23:46:09 user nova-compute[72954]:         <nova:port uuid="bbe133bb-92bc-4c89-9dff-c1d034430830">
Sep 04 23:46:09 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:46:09 user nova-compute[72954]:         </nova:port>
Sep 04 23:46:09 user nova-compute[72954]:       </nova:ports>
Sep 04 23:46:09 user nova-compute[72954]:     </nova:instance>
Sep 04 23:46:09 user nova-compute[72954]:   </metadata>
Sep 04 23:46:09 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:46:09 user nova-compute[72954]:     <system>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="serial">75e269bc-f74f-4233-a59a-729b927f1652</entry>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="uuid">75e269bc-f74f-4233-a59a-729b927f1652</entry>
Sep 04 23:46:09 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:46:09 user nova-compute[72954]:     </system>
Sep 04 23:46:09 user nova-compute[72954]:   </sysinfo>
Sep 04 23:46:09 user nova-compute[72954]:   <os>
Sep 04 23:46:09 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:46:09 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:46:09 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:46:09 user nova-compute[72954]:   </os>
Sep 04 23:46:09 user nova-compute[72954]:   <features>
Sep 04 23:46:09 user nova-compute[72954]:     <acpi/>
Sep 04 23:46:09 user nova-compute[72954]:     <apic/>
Sep 04 23:46:09 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:46:09 user nova-compute[72954]:   </features>
Sep 04 23:46:09 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:46:09 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:46:09 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:46:09 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:46:09 user nova-compute[72954]:   </clock>
Sep 04 23:46:09 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:46:09 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:46:09 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:46:09 user nova-compute[72954]:   </cpu>
Sep 04 23:46:09 user nova-compute[72954]:   <devices>
Sep 04 23:46:09 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:46:09 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:46:09 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk"/>
Sep 04 23:46:09 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:46:09 user nova-compute[72954]:     </disk>
Sep 04 23:46:09 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:46:09 user nova-compute[72954]:       <mac address="fa:16:3e:26:e9:16"/>
Sep 04 23:46:09 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:46:09 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:46:09 user nova-compute[72954]:       <target dev="tapbbe133bb-92"/>
Sep 04 23:46:09 user nova-compute[72954]:     </interface>
Sep 04 23:46:09 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:46:09 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/console.log" append="off"/>
Sep 04 23:46:09 user nova-compute[72954]:     </serial>
Sep 04 23:46:09 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:46:09 user nova-compute[72954]:     <video>
Sep 04 23:46:09 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:46:09 user nova-compute[72954]:     </video>
Sep 04 23:46:09 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:46:09 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:46:09 user nova-compute[72954]:     </rng>
Sep 04 23:46:09 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:46:09 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:46:09 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:46:09 user nova-compute[72954]:     </memballoon>
Sep 04 23:46:09 user nova-compute[72954]:   </devices>
Sep 04 23:46:09 user nova-compute[72954]: </domain>
Sep 04 23:46:09 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1860626477',display_name='tempest-AttachVolumeTestJSON-server-1860626477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1860626477',id=34,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFRNcLx2/F732z375QS/ZuNgWNTwiG4nZq8Xhyg+B9tmI4lbhwUbRSnReglz9H/AjMRx+ojRP7i/hzH/P60BJc/lFI9dV+YJOcBIXF9C9eAq/0nHsHRx/cqJtupPOEEbQ==',key_name='tempest-keypair-1522777488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-ke30losl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:46:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=75e269bc-f74f-4233-a59a-729b927f1652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG os_vif [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbe133bb-92, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbe133bb-92, col_values=(('external_ids', {'iface-id': 'bbe133bb-92bc-4c89-9dff-c1d034430830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:e9:16', 'vm-uuid': '75e269bc-f74f-4233-a59a-729b927f1652'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: INFO os_vif [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92')
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No VIF found with MAC fa:16:3e:26:e9:16, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updated VIF entry in instance network info cache for port bbe133bb-92bc-4c89-9dff-c1d034430830. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating instance_info_cache with network_info: [{"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c1b2411c-e057-4341-99bc-808a68ae5c14 req-60bd46d4-b6b5-43b1-bfdb-423734ac012a service nova] Releasing lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] No waiting events found dispatching network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:10 user nova-compute[72954]: WARNING nova.compute.manager [req-f29e09c2-5c5c-4546-ab17-a130973214ef req-58829600-4280-4312-b57b-3173fcf5c29b service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received unexpected event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 for instance with vm_state building and task_state spawning.
Sep 04 23:46:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] No waiting events found dispatching network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:10 user nova-compute[72954]: WARNING nova.compute.manager [req-54e9c4ce-14ee-4129-96cc-d62cf5b4a558 req-8d4ceecb-9c99-4d65-bc08-33351757cb6d service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received unexpected event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 for instance with vm_state building and task_state spawning.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871171.0235407, ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] VM Resumed (Lifecycle Event)
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Instance spawned successfully.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871171.0277376, ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] VM Started (Lifecycle Event)
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Took 5.57 seconds to spawn the instance on the hypervisor.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Took 6.36 seconds to build instance.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-347c2fc5-2626-4197-a6de-ed1fd8da07d5 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.017s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:11 user nova-compute[72954]: INFO nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:46:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871172.797638, 75e269bc-f74f-4233-a59a-729b927f1652 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] VM Resumed (Lifecycle Event)
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Instance spawned successfully.
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] No waiting events found dispatching network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:12 user nova-compute[72954]: WARNING nova.compute.manager [req-b5005169-9571-4168-9597-2df5d0b209ce req-be031972-7b73-4803-973a-67fecc5cac2d service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received unexpected event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 for instance with vm_state building and task_state spawning.
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871172.7999086, 75e269bc-f74f-4233-a59a-729b927f1652 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] VM Started (Lifecycle Event)
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Took 5.58 seconds to spawn the instance on the hypervisor.
Sep 04 23:46:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:12 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:46:13 user nova-compute[72954]: INFO nova.compute.manager [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Took 6.39 seconds to build instance.
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c561dafc-c4af-4513-8569-c422d3abc1f2 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.507s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:46:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-changed-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing instance network info cache due to event network-changed-9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updated VIF entry in instance network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1823fb97-123c-448b-b8d2-8de622c09125 req-8d529748-7c94-4550-90f2-2537700941e1 service nova] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:17 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.267066955566406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 6605195e-6cd2-4fe7-9fb0-786a25557498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ea7bdfdb-4756-44cc-8303-c9333e801500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 75e269bc-f74f-4233-a59a-729b927f1652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:46:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:22 user nova-compute[72954]: INFO nova.compute.manager [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Shelving
Sep 04 23:46:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:22 user nova-compute[72954]: WARNING nova.compute.manager [req-6b50cf06-9782-417a-ab22-54d8fe2e87cc req-63e63515-3631-4d55-9778-7e88b4c621a1 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state active and task_state shelving.
Sep 04 23:46:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance destroyed successfully.
Sep 04 23:46:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Beginning cold snapshot process
Sep 04 23:46:23 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:46:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk /opt/stack/data/nova/instances/snapshots/tmp7lum25xf/52f7c0c7f9784eceb3c25985f6f6d954 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:46:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk /opt/stack/data/nova/instances/snapshots/tmp7lum25xf/52f7c0c7f9784eceb3c25985f6f6d954" returned: 0 in 0.687s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:46:24 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Snapshot extracted, beginning image upload
Sep 04 23:46:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:24 user nova-compute[72954]: WARNING nova.compute.manager [req-44343dbb-5c40-470f-81f8-b963661a15aa req-9a3aa6f2-6fa2-44c2-8b9c-07ab68b89a82 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state active and task_state shelving_image_uploading.
Sep 04 23:46:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Snapshot image upload complete
Sep 04 23:46:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:26 user nova-compute[72954]: INFO nova.compute.manager [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Shelve offloading
Sep 04 23:46:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance destroyed successfully.
Sep 04 23:46:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:46:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:27 user nova-compute[72954]: INFO nova.compute.manager [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Terminating instance
Sep 04 23:46:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-fad58189-da8e-43ee-830f-28306d2fe7b1 req-71b293ef-605b-4a4d-bba4-bc334d98ffd0 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-unplugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance destroyed successfully.
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'resources' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuGVgFqlIh8+IeKUWFcplbdBivrDYPQzPemw/oL4Rp+Sfl/aj2hhXsiqkRCSEpRKc5LQFlA1LzQuMGC7AzJHBmOTvv5GBnY3xV/4X1ozfX0qefSZFnFQcUvnyxRUXC13Q==',key_name='tempest-keypair-1273442277',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:46:26.510379',shelved_host='user',shelved_image_id='871d8381-f907-42aa-825f-772d485a51f5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG os_vif [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b466066-42, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: INFO os_vif [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42')
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Deleting instance files /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500_del
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Deletion of /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500_del complete
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Instance destroyed successfully.
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lazy-loading 'resources' on Instance uuid ed91c1df-b7fe-4289-9e55-2c5e75e55e35 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1947844586',display_name='tempest-TestMinimumBasicScenario-server-1947844586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1947844586',id=30,image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+kmECnnCfUZhXZBpj5gHVV2KbyPSeiuDdLM9zaCuAX0b/eW2yG8HBlAQ4G4LWsEaiIVBHNnpBzrQqH/aca3QhI4RnSgyerANe0eDCRfOlov5mbPhjeLAdLR44bwmyPLw==',key_name='tempest-TestMinimumBasicScenario-1613538953',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:41:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fc8d5e6302420a8056028f7c9bbdf6',ramdisk_id='',reservation_id='r-qj3f4311',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='901bf645-4764-4284-bbe9-b1dde76b332b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-339041348',owner_user_name='tempest-TestMinimumBasicScenario-339041348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:43:43Z,user_data=None,user_id='b754b34e954e435a97130f83ef9d5622',uuid=ed91c1df-b7fe-4289-9e55-2c5e75e55e35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converting VIF {"id": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "address": "fa:16:3e:7f:54:08", "network": {"id": "3bae5624-ffab-4e6d-994f-2827433061f1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-943957320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fc8d5e6302420a8056028f7c9bbdf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce7d1d21-00", "ovs_interfaceid": "ce7d1d21-00e9-4605-9bbb-17a509c6177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG os_vif [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce7d1d21-00, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:46:28 user nova-compute[72954]: INFO os_vif [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:08,bridge_name='br-int',has_traffic_filtering=True,id=ce7d1d21-00e9-4605-9bbb-17a509c6177b,network=Network(3bae5624-ffab-4e6d-994f-2827433061f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce7d1d21-00')
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Deleting instance files /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35_del
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Deletion of /opt/stack/data/nova/instances/ed91c1df-b7fe-4289-9e55-2c5e75e55e35_del complete
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Deleted allocations for instance ea7bdfdb-4756-44cc-8303-c9333e801500
Sep 04 23:46:28 user nova-compute[72954]: INFO nova.compute.manager [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Took 0.86 seconds to destroy the instance on the hypervisor.
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'numa_topology' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.objects.base [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ea7bdfdb-4756-44cc-8303-c9333e801500> lazy-loaded attributes: resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9c0cf558-2513-41c2-a9d2-54b41ddf19b1 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.744s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:29 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Took 0.55 seconds to deallocate network for instance.
Sep 04 23:46:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:29 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Deleted allocations for instance ed91c1df-b7fe-4289-9e55-2c5e75e55e35
Sep 04 23:46:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-20156863-3927-4655-af08-e3737def1d09 tempest-TestMinimumBasicScenario-339041348 tempest-TestMinimumBasicScenario-339041348-project-member] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] Acquiring lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] Lock "ed91c1df-b7fe-4289-9e55-2c5e75e55e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] No waiting events found dispatching network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:30 user nova-compute[72954]: WARNING nova.compute.manager [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received unexpected event network-vif-plugged-ce7d1d21-00e9-4605-9bbb-17a509c6177b for instance with vm_state deleted and task_state None.
Sep 04 23:46:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-52186f78-7ac9-4620-94e2-6dd988f82681 req-1a058025-d9e3-4897-a0cf-83c4cf3d6088 service nova] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Received event network-vif-deleted-ce7d1d21-00e9-4605-9bbb-17a509c6177b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:34 user nova-compute[72954]: INFO nova.compute.manager [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Terminating instance
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-f9b2427b-fd47-492f-8f67-16b5a5053cf8 req-39452ccd-e367-42fe-ac0a-f68c51c94c7f service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-unplugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:46:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Instance destroyed successfully.
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lazy-loading 'resources' on Instance uuid 09afe965-5ce9-43b6-83f7-f0e378ef33e9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-971205064',display_name='tempest-ServerRescueNegativeTestJSON-server-971205064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-971205064',id=1,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df8caf44b9944100837bfc22addb20d7',ramdisk_id='',reservation_id='r-eaz8vxab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1542679090',owner_user_name='tempest-ServerRescueNegativeTestJSON-1542679090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:35:52Z,user_data=None,user_id='84a77f46b55f4de2aac8145636dda0b5',uuid=09afe965-5ce9-43b6-83f7-f0e378ef33e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converting VIF {"id": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "address": "fa:16:3e:19:68:33", "network": {"id": "bb638234-ca84-44eb-815c-d3c3c8cb2d69", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1565983747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df8caf44b9944100837bfc22addb20d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b998d2-ca", "ovs_interfaceid": "11b998d2-ca1a-47a1-8b34-3b23dc55a938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG os_vif [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b998d2-ca, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:46:34 user nova-compute[72954]: INFO os_vif [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:68:33,bridge_name='br-int',has_traffic_filtering=True,id=11b998d2-ca1a-47a1-8b34-3b23dc55a938,network=Network(bb638234-ca84-44eb-815c-d3c3c8cb2d69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b998d2-ca')
Sep 04 23:46:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Deleting instance files /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9_del
Sep 04 23:46:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Deletion of /opt/stack/data/nova/instances/09afe965-5ce9-43b6-83f7-f0e378ef33e9_del complete
Sep 04 23:46:35 user nova-compute[72954]: INFO nova.compute.manager [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Took 0.90 seconds to destroy the instance on the hypervisor.
Sep 04 23:46:35 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:46:35 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Took 0.66 seconds to deallocate network for instance.
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-b49e7dee-57a7-414a-8328-2a1a87586a25 req-03a3156f-9c78-4671-968e-6ce222d1554d service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-deleted-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:46:35 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:36 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Deleted allocations for instance 09afe965-5ce9-43b6-83f7-f0e378ef33e9
Sep 04 23:46:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d1be9850-a3f6-4352-acbf-9a1809e8965b tempest-ServerRescueNegativeTestJSON-1542679090 tempest-ServerRescueNegativeTestJSON-1542679090-project-member] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] Acquiring lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] Lock "09afe965-5ce9-43b6-83f7-f0e378ef33e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:46:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] No waiting events found dispatching network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:46:36 user nova-compute[72954]: WARNING nova.compute.manager [req-cd61d60b-a600-4605-80cf-2a8aed1617c5 req-6a961b04-c0a0-48ad-9df5-74339ca45146 service nova] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Received unexpected event network-vif-plugged-11b998d2-ca1a-47a1-8b34-3b23dc55a938 for instance with vm_state deleted and task_state None.
Sep 04 23:46:38 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871183.1050694, ea7bdfdb-4756-44cc-8303-c9333e801500 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:38 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Stopped (Lifecycle Event)
Sep 04 23:46:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3b433ef3-9b1b-4c92-99a9-ccc0e236f6e5 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:43 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871188.498204, ed91c1df-b7fe-4289-9e55-2c5e75e55e35 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:43 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] VM Stopped (Lifecycle Event)
Sep 04 23:46:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-4f1002fc-ce24-4994-a17e-b452fc49a8a0 None None] [instance: ed91c1df-b7fe-4289-9e55-2c5e75e55e35] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:49 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871194.898575, 09afe965-5ce9-43b6-83f7-f0e378ef33e9 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:46:49 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] VM Stopped (Lifecycle Event)
Sep 04 23:46:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-5051133b-1d2b-4e47-ae48-28f3aeac46b5 None None] [instance: 09afe965-5ce9-43b6-83f7-f0e378ef33e9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:46:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:46:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-changed-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG nova.compute.manager [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Refreshing instance network info cache due to event network-changed-623f4a68-c81d-4e52-87ea-4593ab6b3074. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Refreshing network info cache for port 623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updated VIF entry in instance network info cache for port 623f4a68-c81d-4e52-87ea-4593ab6b3074. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:47:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a3b3c488-f2c5-45f7-915d-d1559aefaee8 req-a48048d8-a349-4521-815f-dc50f7af63a0 service nova] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:47:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:06 user nova-compute[72954]: INFO nova.compute.manager [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attaching volume 713c8617-9043-4531-bca2-9a36f64e8eab to /dev/vdb
Sep 04 23:47:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.utils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8adc6a-bfdd-4a52-bf34-f48b613f691f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b58e4c-7642-453e-86dd-e76cc73fb602]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e732d44-9392-42f2-bcca-bd61e653c97a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0525711-e73c-4910-9a70-75e52515e569]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:47:06 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:47:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed356f-8e4c-45eb-85a6-8bb15503bde8]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG os_brick.utils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:47:06 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating existing volume attachment record: 36802828-1e55-4cfd-8085-34a7b903623d {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:09 user nova-compute[72954]: INFO nova.compute.manager [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Terminating instance
Sep 04 23:47:09 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-unplugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-unplugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-2126b078-bc4d-4dc8-b773-1a2c34d93f9e req-eb376023-e1e5-45e9-837e-1246a8f6fb47 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-unplugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:47:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Instance destroyed successfully.
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lazy-loading 'resources' on Instance uuid 6605195e-6cd2-4fe7-9fb0-786a25557498 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:38:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-375058730',display_name='tempest-ServersNegativeTestJSON-server-375058730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-375058730',id=25,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='537dec2432d9404b94f2f5f16ab0c193',ramdisk_id='',reservation_id='r-0yptab3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-817858437',owner_user_name='tempest-ServersNegativeTestJSON-817858437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:38:17Z,user_data=None,user_id='8e70c64a167d478a82d96dce40a11a8e',uuid=6605195e-6cd2-4fe7-9fb0-786a25557498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converting VIF {"id": "20acd0d0-956c-4af7-9ce2-5918a7678207", "address": "fa:16:3e:bf:b7:f7", "network": {"id": "9ae7a040-3acc-4bbf-a070-029ea98aad03", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-231132178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "537dec2432d9404b94f2f5f16ab0c193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20acd0d0-95", "ovs_interfaceid": "20acd0d0-956c-4af7-9ce2-5918a7678207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG os_vif [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20acd0d0-95, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:47:10 user nova-compute[72954]: INFO os_vif [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b7:f7,bridge_name='br-int',has_traffic_filtering=True,id=20acd0d0-956c-4af7-9ce2-5918a7678207,network=Network(9ae7a040-3acc-4bbf-a070-029ea98aad03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20acd0d0-95')
Sep 04 23:47:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Deleting instance files /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498_del
Sep 04 23:47:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Deletion of /opt/stack/data/nova/instances/6605195e-6cd2-4fe7-9fb0-786a25557498_del complete
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: INFO nova.compute.manager [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Took 0.72 seconds to destroy the instance on the hypervisor.
Sep 04 23:47:10 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:47:10 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Took 0.54 seconds to deallocate network for instance.
Sep 04 23:47:10 user nova-compute[72954]: DEBUG nova.compute.manager [req-1862f0b7-3126-4404-8e02-2617daf7196a req-ef7c5eb8-4b2e-4634-850a-9fe73396f624 service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-deleted-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:11 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:47:11 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:47:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:11 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Deleted allocations for instance 6605195e-6cd2-4fe7-9fb0-786a25557498
Sep 04 23:47:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7ac1e25b-60a2-4bfd-bafd-30535037b27e tempest-ServersNegativeTestJSON-817858437 tempest-ServersNegativeTestJSON-817858437-project-member] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:47:12 user nova-compute[72954]: WARNING nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received unexpected event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with vm_state deleted and task_state None.
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:47:12 user nova-compute[72954]: WARNING nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received unexpected event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with vm_state deleted and task_state None.
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Acquiring lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] Lock "6605195e-6cd2-4fe7-9fb0-786a25557498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] No waiting events found dispatching network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:47:12 user nova-compute[72954]: WARNING nova.compute.manager [req-6e624dd4-a170-4d22-8c60-adc206830e17 req-11865841-3440-4abf-bded-3a980ecec3fa service nova] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Received unexpected event network-vif-plugged-20acd0d0-956c-4af7-9ce2-5918a7678207 for instance with vm_state deleted and task_state None.
Sep 04 23:47:13 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:13 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:47:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.271514892578125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 75e269bc-f74f-4233-a59a-729b927f1652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:47:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:25 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871230.1954017, 6605195e-6cd2-4fe7-9fb0-786a25557498 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:47:25 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] VM Stopped (Lifecycle Event)
Sep 04 23:47:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65d720bf-f82c-4d28-9e74-66eca324f16c None None] [instance: 6605195e-6cd2-4fe7-9fb0-786a25557498] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:47:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:47:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:47:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:47:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:47:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:47:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [{"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:47:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-2bab57e0-c079-4701-9d61-7dd1a050068c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:47:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:47:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:33 user nova-compute[72954]: INFO nova.compute.manager [None req-73dcdc4d-3233-4a69-8b8b-b1e97d82eaf4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Get console output
Sep 04 23:47:33 user nova-compute[72954]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Sep 04 23:47:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:47:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SebmHNuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:47:39 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:47:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:47:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:47:40 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:47:40 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d681d84-fe31-4e6b-b3d9-3e4d0984197b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:47:40 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bb082-14b0-4137-89fd-8b39be8e5b60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab] added
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcac9c31-52b5-403c-8e24-6c11daac2df7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7365e3a-b0be-4b72-af7f-d72bbeabbb6b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SebmHNuz {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SebmHNuz" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cacaeb2-892f-459c-b02f-12bff0048f95]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SebmHNuz'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4480e3e-849e-4abb-9868-b78c25fad54f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1918d6f-dbb7-41ea-9f4f-35bbdf9befb0]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321e02b-97fa-4aa7-ab9a-2ca14d149217]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260]
Sep 04 23:47:40 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260] successful.
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9aaf67-02ea-4504-9ab8-cecbad4d0584]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5998b7-7293-4b12-8e50-1cf7f86a2331]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:47:40 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:47:40 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:47:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac1ab9-9d32-488d-82cf-6fbbe2689bf6]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:47:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SebmHNuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26564323933336138', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564323933336138', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.objects.instance [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:47:41 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:47:41 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:47:41 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:47:41 user nova-compute[72954]:   <serial>713c8617-9043-4531-bca2-9a36f64e8eab</serial>
Sep 04 23:47:41 user nova-compute[72954]: </disk>
Sep 04 23:47:41 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No VIF found with MAC fa:16:3e:4c:76:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:47:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-ef058812-034b-4b22-bfb5-f6a5e3ebe705 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.424s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-changed-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Refreshing instance network info cache due to event network-changed-465d9522-f495-4581-8eff-4b39422477e2. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] Acquiring lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] Acquired lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:47:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Refreshing network info cache for port 465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:47:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:47:56 user nova-compute[72954]: DEBUG nova.network.neutron [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updated VIF entry in instance network info cache for port 465d9522-f495-4581-8eff-4b39422477e2. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:47:56 user nova-compute[72954]: DEBUG nova.network.neutron [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updating instance_info_cache with network_info: [{"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:47:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3af3997c-01cb-42ab-884f-7949d107d360 req-61ef7241-1c49-4536-b574-b309d4507d8f service nova] Releasing lock "refresh_cache-ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG nova.objects.instance [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:47:57 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Ignoring supplied device name: /dev/vdb
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:47:57 user nova-compute[72954]: INFO nova.compute.manager [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Attaching volume bd39b428-a6af-4046-b540-5cb9ea65eddf to /dev/vdb
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.utils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fbc853-79be-4d9a-96e8-2e56a5efa45b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[514632e6-4ced-4575-a6a6-840c7ef521d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[43390580-b0ad-4668-9d42-27fc56a3aecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb10f9-2afe-4a0f-9ec9-0ff110a343e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:47:57 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812be66-06ff-47ee-ae80-4a5e67afdd27]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG os_brick.utils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updating existing volume attachment record: 3a496221-bd88-4253-9555-5e5edf52691f {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-changed-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Refreshing instance network info cache due to event network-changed-bbe133bb-92bc-4c89-9dff-c1d034430830. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] Acquiring lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] Acquired lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:47:57 user nova-compute[72954]: DEBUG nova.network.neutron [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Refreshing network info cache for port bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:47:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updated VIF entry in instance network info cache for port bbe133bb-92bc-4c89-9dff-c1d034430830. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:47:58 user nova-compute[72954]: DEBUG nova.network.neutron [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating instance_info_cache with network_info: [{"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:47:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9d4334e1-e1d3-45ac-ba5f-46608bd70d02 req-7f217bfd-8a2f-41a3-a2e8-2cacd6a55a79 service nova] Releasing lock "refresh_cache-75e269bc-f74f-4233-a59a-729b927f1652" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:47:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:02 user nova-compute[72954]: INFO nova.compute.manager [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attaching volume 37e673c8-9bcc-476c-bf85-79d5b39ff711 to /dev/vdb
Sep 04 23:48:02 user nova-compute[72954]: DEBUG os_brick.utils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4beba-56b2-4469-b7dd-2cbffa8bd291]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ac196-a79a-4663-9166-4a34b897cfe3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde8bb3-eac4-41d6-be6a-3fbbb87120d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf90dbe-f9d3-4cb5-8335-519ed9418d27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:03 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:48:03 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d93504-0f25-45db-a043-3ee6afbeb959]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG os_brick.utils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:03 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating existing volume attachment record: b409316e-7f2a-4ab6-bff2-a4dc1a726291 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:48:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVXWuDoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:14 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:14 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:14 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b576d37-600b-4cdd-848b-efb8a694d7ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:48:14 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05354c9-4ef9-4c7e-9e84-0a57f4fbe437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf] added
Sep 04 23:48:14 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1591da6-e860-496b-973c-7c31286b19fe]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80a0ab-7720-4c9c-9604-c6926e8be84a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVXWuDoG {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVXWuDoG" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c18cdf-23d5-41b8-b82b-103fbb4b4177]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVXWuDoG'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c225a-1f17-460c-ac78-51b0098b1e19]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bcb47d-414b-4097-acf3-de6c9c05615f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f55fca-e07e-4c0b-8ecc-1d51dcc71fc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260]
Sep 04 23:48:15 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c34dbf-b51d-4b21-81f5-a5d3b55d21fd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0ba7e-5103-4806-8f5a-927442deaa74]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:15 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:15 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63c43a-56ab-4e59-9f3f-024df66be455]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVXWuDoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:15 user nova-compute[72954]: INFO nova.compute.manager [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Unshelving
Sep 04 23:48:15 user nova-compute[72954]: INFO nova.virt.block_device [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Booting with volume 728375eb-dd81-427d-abb5-f243ac726305 at /dev/vdc
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.utils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba9790-e4e3-4910-9005-7c79b0dcef06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6d4748-f93e-43c6-89f6-67a13605cc97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c36d14-1358-48aa-a13e-dcfda953e5c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0562bd15-ff19-4190-91fb-e36ea31a90af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:15 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaceb80-7c05-442b-bc28-7551f416191f]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG os_brick.utils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating existing volume attachment record: 1f4ebcf0-22f9-4135-8ca6-1d7302c6b0f9 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:15 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23234316636666532', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234316636666532', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.objects.instance [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:48:16 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:16 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:48:16 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:16 user nova-compute[72954]:   <serial>bd39b428-a6af-4046-b540-5cb9ea65eddf</serial>
Sep 04 23:48:16 user nova-compute[72954]: </disk>
Sep 04 23:48:16 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] No VIF found with MAC fa:16:3e:fd:bb:ee, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:16 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-35301a8c-8a7f-482c-ab40-3b872b9d18b0 tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.690s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:18 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8047MB free_disk=25.282665252685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 2bab57e0-c079-4701-9d61-7dd1a050068c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 75e269bc-f74f-4233-a59a-729b927f1652 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ea7bdfdb-4756-44cc-8303-c9333e801500 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:48:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:20 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjsgypHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:21 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:21 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:21 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[685177cf-8638-474d-9780-98bda6c9791f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:48:21 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad2c3c2-751c-4bf6-a9fb-11aa4a5cb969]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711] added
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c536710-11df-4cfc-b850-bae05cb296c3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5465dbf-5741-4be0-85b3-ca9b26a2c19e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjsgypHE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rjsgypHE" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91fe4f9-c65b-425e-97a5-2b3d312cd220]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rjsgypHE'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a177a3c-acb0-4e8e-a0e0-7962f644da48]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40e249-7189-4bd0-a1ba-e07d9a5d507b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0c353-cdf5-4987-971a-8f48c2523703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260]
Sep 04 23:48:21 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47ecba-d107-4d10-b319-4cf95e52ec63]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d930a-9138-4c5b-9300-c12383c1711a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:21 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[06231a61-1036-435a-8d27-ce21b5be3466]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjsgypHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23661663764363838', 'path': '/dev/sde'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663764363838', 'path': '/dev/sde'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:22 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:48:22 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:22 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:48:22 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:22 user nova-compute[72954]:   <serial>37e673c8-9bcc-476c-bf85-79d5b39ff711</serial>
Sep 04 23:48:22 user nova-compute[72954]: </disk>
Sep 04 23:48:22 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No VIF found with MAC fa:16:3e:26:e9:16, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bbc531a3-1f91-4062-b52a-42545161b6f0 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.852s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:25 user nova-compute[72954]: INFO nova.compute.manager [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Detaching volume 713c8617-9043-4531-bca2-9a36f64e8eab
Sep 04 23:48:25 user nova-compute[72954]: INFO nova.virt.block_device [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attempting to driver detach volume 713c8617-9043-4531-bca2-9a36f64e8eab from mountpoint /dev/vdb
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Attempting to detach device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:25 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:25 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:48:25 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:25 user nova-compute[72954]:   <serial>713c8617-9043-4531-bca2-9a36f64e8eab</serial>
Sep 04 23:48:25 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:48:25 user nova-compute[72954]: </disk>
Sep 04 23:48:25 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config.
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:25 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:25 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:48:25 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:25 user nova-compute[72954]:   <serial>713c8617-9043-4531-bca2-9a36f64e8eab</serial>
Sep 04 23:48:25 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:48:25 user nova-compute[72954]: </disk>
Sep 04 23:48:25 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871305.9823718, 29c1b984-b059-4a9c-8137-59391b5990bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:48:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config.
Sep 04 23:48:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SebmHNuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:25 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8be993-ad78-414d-9b91-2b92af6930c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b472108b-bae9-4923-911f-8230e0e9810a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:26 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130105990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77c62a-a1ef-44a9-8c09-2d8061b4b1ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a0820-bc74-4359-bcc5-fe4ab773db8c]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec70245-ceb2-418a-a1aa-ab9c7f4e56b2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43d062-ce13-4245-bfe2-b72328bba06d]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30dbee5-4024-433c-be25-255a83c1e9bc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936c0d5-02db-4b28-a35f-84b49e382f96]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260]
Sep 04 23:48:26 user nova-compute[72954]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:713c8617-9043-4531-bca2-9a36f64e8eab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dde9ad-55a3-470b-aa80-cf86d158d1a3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== disconnect_volume: return (347ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:48:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:27 user nova-compute[72954]: DEBUG nova.objects.instance [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6cf5d6d9-e6c7-4256-9246-1b47d0faeeda tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.061s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:30 user nova-compute[72954]: INFO nova.compute.manager [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attaching volume 39753e2e-53da-451e-b0cd-b7e12c5286c3 to /dev/vdc
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.utils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb4436-402b-4284-b3e5-38c801a40653]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1ade2-326c-43fb-81c5-24c3f9904a20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c59bd-1ff6-4ec2-b49c-46a12707ae62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[962a7971-9d12-4fad-a0e4-8a394b3facee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:48:30 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa81f881-912c-42d9-abb2-c4f29a51906a]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG os_brick.utils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating existing volume attachment record: 2d5d7d21-13b1-48c4-b118-a1e114bc6272 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:48:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9949}}
Sep 04 23:48:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:48:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:48:31 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:48:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_requests' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'numa_topology' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:48:32 user nova-compute[72954]: INFO nova.compute.claims [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Claim successful on node user
Sep 04 23:48:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:48:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:48:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:33 user nova-compute[72954]: INFO nova.network.neutron [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating port 9b466066-4269-4d95-97ea-b349d70475bc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:34 user nova-compute[72954]: INFO nova.compute.manager [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Terminating instance
Sep 04 23:48:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-changed-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing instance network info cache due to event network-changed-9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:48:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:48:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Instance destroyed successfully.
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'resources' on Instance uuid 2bab57e0-c079-4701-9d61-7dd1a050068c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-915815952',display_name='tempest-ServerActionsTestOtherA-server-915815952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-915815952',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-ziqe6mg8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=2bab57e0-c079-4701-9d61-7dd1a050068c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "address": "fa:16:3e:d6:d5:41", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3562d996-12", "ovs_interfaceid": "3562d996-1212-4b5c-a48d-9f9dc4fa6f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_vif [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3562d996-12, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:35 user nova-compute[72954]: INFO os_vif [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:41,bridge_name='br-int',has_traffic_filtering=True,id=3562d996-1212-4b5c-a48d-9f9dc4fa6f1b,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3562d996-12')
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZeOPTpB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d01981-530e-45ba-8b10-c4ccb6ce97a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab556fd-3cab-44c9-8d8f-48d3a56f7821]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:35 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:35 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf (non-flash)
Sep 04 23:48:35 user nova-compute[72954]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:35 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11825f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f629c8-4f05-49f2-ad37-1c2abf416d53]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff80f462-9ce4-49bb-87ec-479e93f03937]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[64776259-4564-457d-9112-e80ac33a9b82]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:48:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Creating image(s)
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Refreshing network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG nova.objects.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ea7bdfdb-4756-44cc-8303-c9333e801500> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "e16d6b51a02780ae799b5389b3ace39ed0121459" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e16d6b51a02780ae799b5389b3ace39ed0121459" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80315bff-b8ff-4e48-98b8-8e341fead395]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26433373064653666', '/dev/disk/by-id/scsi-1SCST_BIO929b898f-d370de6f79f7cb0c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_929b898f') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 04 23:48:35 user nova-compute[72954]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO929b898f-d370de6f79f7cb0c
Sep 04 23:48:35 user nova-compute[72954]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_929b898f
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa173222-d05b-4d3c-8555-77b3e04a6cb3]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e577390-f26c-4b1b-ad9d-7c2c55b3d58e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e74476-b0bb-4b09-9d2d-e9ef51fcf1ac]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260]
Sep 04 23:48:36 user nova-compute[72954]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deec85db-8217-49dc-8137-2a7ef19a8cbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698ab05-7e68-4e00-8ff1-f17f1198643e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.863s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] <== disconnect_volume: return (1865ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:48:36 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Deleting instance files /opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c_del
Sep 04 23:48:36 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Deletion of /opt/stack/data/nova/instances/2bab57e0-c079-4701-9d61-7dd1a050068c_del complete
Sep 04 23:48:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Took 2.89 seconds to destroy the instance on the hypervisor.
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.part --force-share --output=json" returned: 0 in 0.235s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.virt.images [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] 871d8381-f907-42aa-825f-772d485a51f5 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.part /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.part /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.converted" returned: 0 in 0.759s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updated VIF entry in instance network info cache for port 9b466066-4269-4d95-97ea-b349d70475bc. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-68806045-8f9d-49e0-8196-5d7765b8c785 req-3de7002c-f19f-40b7-87cd-cb75008b2df2 service nova] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e16d6b51a02780ae799b5389b3ace39ed0121459" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.814s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json" returned: 0 in 0.200s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "e16d6b51a02780ae799b5389b3ace39ed0121459" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e16d6b51a02780ae799b5389b3ace39ed0121459" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-1570f845-f001-41e5-847f-2762c19918e1 req-12653f97-f73a-4b97-85d5-e60d703717f0 service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-unplugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json" returned: 0 in 0.431s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459,backing_fmt=raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459,backing_fmt=raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk 1073741824" returned: 0 in 0.057s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e16d6b51a02780ae799b5389b3ace39ed0121459" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.492s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:38 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Took 1.79 seconds to deallocate network for instance.
Sep 04 23:48:38 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:48:38 user nova-compute[72954]: INFO nova.compute.claims [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Claim successful on node user
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'migration_context' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.objects.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ea7bdfdb-4756-44cc-8303-c9333e801500> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:48:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Rebasing disk image.
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb -F raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:48:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.policy [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2599232791bb463b8b2f725cb65431ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511811307c7443b966505de3e319a64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:48:39 user nova-compute[72954]: INFO nova.compute.manager [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Took 0.95 seconds to detach 1 volumes for instance.
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Deleting volume: deec85db-8217-49dc-8137-2a7ef19a8cbf {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:48:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Creating image(s)
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "/opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "/opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "/opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.254s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.288s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:40 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Deleted allocations for instance 2bab57e0-c079-4701-9d61-7dd1a050068c
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Successfully created port: 3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] Acquiring lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] No waiting events found dispatching network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:40 user nova-compute[72954]: WARNING nova.compute.manager [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received unexpected event network-vif-plugged-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b for instance with vm_state deleted and task_state None.
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-b8b481fb-4013-4750-b57a-7b5d64da9149 req-6337289b-35a7-4270-b0ed-02f9bdbbad9a service nova] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Received event network-vif-deleted-3562d996-1212-4b5c-a48d-9f9dc4fa6f1b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk 1073741824" returned: 0 in 0.077s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.202s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9a837fb6-c226-4de1-a0fc-091667debed1 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "2bab57e0-c079-4701-9d61-7dd1a050068c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.659s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Cannot resize image /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Successfully updated port: 3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:48:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:48:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquired lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:48:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:48:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb -F raw /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk" returned: 0 in 2.837s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Ensure instance console log exists: /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start _get_guest_xml network_info=[{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d4752ebe23821e777801889d57d9443c',container_format='bare',created_at=2023-09-04T23:46:22Z,direct_url=<?>,disk_format='qcow2',id=871d8381-f907-42aa-825f-772d485a51f5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2111222641-shelved',owner='c910f268091a4c1090fb8adc3942c928',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:46:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXZSiljM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ea7bdfdb-4756-44cc-8303-c9333e801500', 'attached_at': '', 'detached_at': '', 'volume_id': '728375eb-dd81-427d-abb5-f243ac726305', 'serial': '728375eb-dd81-427d-abb5-f243ac726305'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '1f4ebcf0-22f9-4135-8ca6-1d7302c6b0f9', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:48:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updating instance_info_cache with network_info: [{"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d4752ebe23821e777801889d57d9443c',container_format='bare',created_at=2023-09-04T23:46:22Z,direct_url=<?>,disk_format='qcow2',id=871d8381-f907-42aa-825f-772d485a51f5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2111222641-shelved',owner='c910f268091a4c1090fb8adc3942c928',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:46:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Releasing lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Instance network_info: |[{"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Start _get_guest_xml network_info=[{"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:48:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.objects.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ea7bdfdb-4756-44cc-8303-c9333e801500> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXZSiljM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:42 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1934944',id=35,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS1QXdNOPPnahRI+l0+ehQNj/ZicERWZcM6CA5faYw5SnyvBbspVfUtlLRXNgaIsmm/2DWQwQ9YbNZ9JvJidM0Lrq+K9DXFC4LrM2UTM5S+LilzQBhp4T8sIUI8/bRjvw==',key_name='tempest-keypair-227029074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4511811307c7443b966505de3e319a64',ramdisk_id='',reservation_id='r-6fy9fdov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2599232791bb463b8b2f725cb65431ad',uuid=45e0a0aa-766f-4c33-b91c-f1fb56019b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converting VIF {"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lazy-loading 'pci_devices' on Instance uuid 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222a4ab-2d4e-4d3f-aeb4-5228ecb57c4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:48:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:48:42 user nova-compute[72954]:   <uuid>45e0a0aa-766f-4c33-b91c-f1fb56019b3a</uuid>
Sep 04 23:48:42 user nova-compute[72954]:   <name>instance-00000023</name>
Sep 04 23:48:42 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:48:42 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:48:42 user nova-compute[72954]:   <metadata>
Sep 04 23:48:42 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:48:42 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020</nova:name>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:48:42</nova:creationTime>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:48:42 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:48:42 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:owner>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:user uuid="2599232791bb463b8b2f725cb65431ad">tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member</nova:user>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:project uuid="4511811307c7443b966505de3e319a64">tempest-TestServerVolumeAttachScenarioOldVersion-2000130752</nova:project>
Sep 04 23:48:42 user nova-compute[72954]:       </nova:owner>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:48:42 user nova-compute[72954]:       <nova:ports>
Sep 04 23:48:42 user nova-compute[72954]:         <nova:port uuid="3e19dddb-1a75-4349-8c64-5a8033a534ea">
Sep 04 23:48:42 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 04 23:48:42 user nova-compute[72954]:         </nova:port>
Sep 04 23:48:42 user nova-compute[72954]:       </nova:ports>
Sep 04 23:48:42 user nova-compute[72954]:     </nova:instance>
Sep 04 23:48:42 user nova-compute[72954]:   </metadata>
Sep 04 23:48:42 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:48:42 user nova-compute[72954]:     <system>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="serial">45e0a0aa-766f-4c33-b91c-f1fb56019b3a</entry>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="uuid">45e0a0aa-766f-4c33-b91c-f1fb56019b3a</entry>
Sep 04 23:48:42 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:48:42 user nova-compute[72954]:     </system>
Sep 04 23:48:42 user nova-compute[72954]:   </sysinfo>
Sep 04 23:48:42 user nova-compute[72954]:   <os>
Sep 04 23:48:42 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:48:42 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:48:42 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:48:42 user nova-compute[72954]:   </os>
Sep 04 23:48:42 user nova-compute[72954]:   <features>
Sep 04 23:48:42 user nova-compute[72954]:     <acpi/>
Sep 04 23:48:42 user nova-compute[72954]:     <apic/>
Sep 04 23:48:42 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:48:42 user nova-compute[72954]:   </features>
Sep 04 23:48:42 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:48:42 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:48:42 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:48:42 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:48:42 user nova-compute[72954]:   </clock>
Sep 04 23:48:42 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:48:42 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:48:42 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:48:42 user nova-compute[72954]:   </cpu>
Sep 04 23:48:42 user nova-compute[72954]:   <devices>
Sep 04 23:48:42 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:48:42 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:48:42 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk"/>
Sep 04 23:48:42 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:48:42 user nova-compute[72954]:     </disk>
Sep 04 23:48:42 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:48:42 user nova-compute[72954]:       <mac address="fa:16:3e:53:c2:5b"/>
Sep 04 23:48:42 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:48:42 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:48:42 user nova-compute[72954]:       <target dev="tap3e19dddb-1a"/>
Sep 04 23:48:42 user nova-compute[72954]:     </interface>
Sep 04 23:48:42 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:48:42 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/console.log" append="off"/>
Sep 04 23:48:42 user nova-compute[72954]:     </serial>
Sep 04 23:48:42 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:48:42 user nova-compute[72954]:     <video>
Sep 04 23:48:42 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:48:42 user nova-compute[72954]:     </video>
Sep 04 23:48:42 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:48:42 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:48:42 user nova-compute[72954]:     </rng>
Sep 04 23:48:42 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:48:42 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:48:42 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:48:42 user nova-compute[72954]:     </memballoon>
Sep 04 23:48:42 user nova-compute[72954]:   </devices>
Sep 04 23:48:42 user nova-compute[72954]: </domain>
Sep 04 23:48:42 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1934944',id=35,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS1QXdNOPPnahRI+l0+ehQNj/ZicERWZcM6CA5faYw5SnyvBbspVfUtlLRXNgaIsmm/2DWQwQ9YbNZ9JvJidM0Lrq+K9DXFC4LrM2UTM5S+LilzQBhp4T8sIUI8/bRjvw==',key_name='tempest-keypair-227029074',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4511811307c7443b966505de3e319a64',ramdisk_id='',reservation_id='r-6fy9fdov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:48:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2599232791bb463b8b2f725cb65431ad',uuid=45e0a0aa-766f-4c33-b91c-f1fb56019b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converting VIF {"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_vif [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde1c65-3c59-4e9b-b1c0-89b9988a2a1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305] added
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e19dddb-1a, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e19dddb-1a, col_values=(('external_ids', {'iface-id': '3e19dddb-1a75-4349-8c64-5a8033a534ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:c2:5b', 'vm-uuid': '45e0a0aa-766f-4c33-b91c-f1fb56019b3a'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:42 user nova-compute[72954]: INFO os_vif [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a')
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53bdaac-2f3d-45cd-99d3-4e87b85b9739]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85077b-71d4-4f1d-bd22-0997c38c4e08]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXZSiljM {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXZSiljM" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e64e6-77de-4e9e-a729-3d1afdc4abfd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXZSiljM'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] No VIF found with MAC fa:16:3e:53:c2:5b, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a59329-773e-4931-8c1b-cc14b2093c98]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bffb309-4301-44a8-8e22-2f0172b2b645]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb4089-67fa-4da7-bbdb-8ddc8872e729]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260]
Sep 04 23:48:42 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319d6e6-2300-4c6c-a86e-b1222d678756]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad428a44-8b95-4613-8321-71087be809fb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca21df9-504d-44d0-b206-908657b5e4c4]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-changed-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Refreshing instance network info cache due to event network-changed-3e19dddb-1a75-4349-8c64-5a8033a534ea. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] Acquiring lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] Acquired lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:48:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Refreshing network info cache for port 3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updated VIF entry in instance network info cache for port 3e19dddb-1a75-4349-8c64-5a8033a534ea. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updating instance_info_cache with network_info: [{"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24aaa7dd-7014-4508-84ba-049e1cea46be req-771fac2b-48f4-4432-9179-929e56ad43b9 service nova] Releasing lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXZSiljM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23536323430396330', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536323430396330', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='871d8381-f907-42aa-825f-772d485a51f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1273442277',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:46:26.510379',shelved_host='user',shelved_image_id='871d8381-f907-42aa-825f-772d485a51f5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.objects.instance [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_devices' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.objects.base [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ea7bdfdb-4756-44cc-8303-c9333e801500> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:48:43 user nova-compute[72954]:   <uuid>ea7bdfdb-4756-44cc-8303-c9333e801500</uuid>
Sep 04 23:48:43 user nova-compute[72954]:   <name>instance-0000001f</name>
Sep 04 23:48:43 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:48:43 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:48:43 user nova-compute[72954]:   <metadata>
Sep 04 23:48:43 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:48:43 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2111222641</nova:name>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:48:42</nova:creationTime>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:48:43 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:48:43 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:owner>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:user uuid="22815594f2334a5aa727b3aab115af7f">tempest-AttachVolumeShelveTestJSON-966339939-project-member</nova:user>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:project uuid="c910f268091a4c1090fb8adc3942c928">tempest-AttachVolumeShelveTestJSON-966339939</nova:project>
Sep 04 23:48:43 user nova-compute[72954]:       </nova:owner>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:root type="image" uuid="871d8381-f907-42aa-825f-772d485a51f5"/>
Sep 04 23:48:43 user nova-compute[72954]:       <nova:ports>
Sep 04 23:48:43 user nova-compute[72954]:         <nova:port uuid="9b466066-4269-4d95-97ea-b349d70475bc">
Sep 04 23:48:43 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 04 23:48:43 user nova-compute[72954]:         </nova:port>
Sep 04 23:48:43 user nova-compute[72954]:       </nova:ports>
Sep 04 23:48:43 user nova-compute[72954]:     </nova:instance>
Sep 04 23:48:43 user nova-compute[72954]:   </metadata>
Sep 04 23:48:43 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:48:43 user nova-compute[72954]:     <system>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="serial">ea7bdfdb-4756-44cc-8303-c9333e801500</entry>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="uuid">ea7bdfdb-4756-44cc-8303-c9333e801500</entry>
Sep 04 23:48:43 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:48:43 user nova-compute[72954]:     </system>
Sep 04 23:48:43 user nova-compute[72954]:   </sysinfo>
Sep 04 23:48:43 user nova-compute[72954]:   <os>
Sep 04 23:48:43 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:48:43 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:48:43 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:48:43 user nova-compute[72954]:   </os>
Sep 04 23:48:43 user nova-compute[72954]:   <features>
Sep 04 23:48:43 user nova-compute[72954]:     <acpi/>
Sep 04 23:48:43 user nova-compute[72954]:     <apic/>
Sep 04 23:48:43 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:48:43 user nova-compute[72954]:   </features>
Sep 04 23:48:43 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:48:43 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:48:43 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:48:43 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:48:43 user nova-compute[72954]:   </clock>
Sep 04 23:48:43 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:48:43 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:48:43 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:48:43 user nova-compute[72954]:   </cpu>
Sep 04 23:48:43 user nova-compute[72954]:   <devices>
Sep 04 23:48:43 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:48:43 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:48:43 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk"/>
Sep 04 23:48:43 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:48:43 user nova-compute[72954]:     </disk>
Sep 04 23:48:43 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:48:43 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:43 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:48:43 user nova-compute[72954]:       <target dev="vdc" bus="virtio"/>
Sep 04 23:48:43 user nova-compute[72954]:       <serial>728375eb-dd81-427d-abb5-f243ac726305</serial>
Sep 04 23:48:43 user nova-compute[72954]:     </disk>
Sep 04 23:48:43 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:48:43 user nova-compute[72954]:       <mac address="fa:16:3e:cf:b2:6d"/>
Sep 04 23:48:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:48:43 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:48:43 user nova-compute[72954]:       <target dev="tap9b466066-42"/>
Sep 04 23:48:43 user nova-compute[72954]:     </interface>
Sep 04 23:48:43 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:48:43 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/console.log" append="off"/>
Sep 04 23:48:43 user nova-compute[72954]:     </serial>
Sep 04 23:48:43 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:48:43 user nova-compute[72954]:     <video>
Sep 04 23:48:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:48:43 user nova-compute[72954]:     </video>
Sep 04 23:48:43 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:48:43 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:48:43 user nova-compute[72954]:     </rng>
Sep 04 23:48:43 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:48:43 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:48:43 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:48:43 user nova-compute[72954]:     </memballoon>
Sep 04 23:48:43 user nova-compute[72954]:   </devices>
Sep 04 23:48:43 user nova-compute[72954]: </domain>
Sep 04 23:48:43 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='871d8381-f907-42aa-825f-772d485a51f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1273442277',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:46:26.510379',shelved_host='user',shelved_image_id='871d8381-f907-42aa-825f-772d485a51f5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG os_vif [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b466066-42, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b466066-42, col_values=(('external_ids', {'iface-id': '9b466066-4269-4d95-97ea-b349d70475bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:b2:6d', 'vm-uuid': 'ea7bdfdb-4756-44cc-8303-c9333e801500'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: INFO os_vif [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42')
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No VIF found with MAC fa:16:3e:cf:b2:6d, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] No waiting events found dispatching network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:44 user nova-compute[72954]: WARNING nova.compute.manager [req-5ae2925d-c25b-4914-b2c3-685e5d8d4789 req-121d526d-1688-4e42-8abc-db2cae4f8386 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received unexpected event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea for instance with vm_state building and task_state spawning.
Sep 04 23:48:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] No waiting events found dispatching network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:46 user nova-compute[72954]: WARNING nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received unexpected event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea for instance with vm_state building and task_state spawning.
Sep 04 23:48:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:46 user nova-compute[72954]: WARNING nova.compute.manager [req-7a491509-51a8-4e64-b984-55cf8311fd97 req-e48c9da6-adcd-4605-b731-4e4cf8da647c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state shelved_offloaded and task_state spawning.
Sep 04 23:48:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871327.637416, 45e0a0aa-766f-4c33-b91c-f1fb56019b3a => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] VM Resumed (Lifecycle Event)
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Instance spawned successfully.
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871327.6427248, 45e0a0aa-766f-4c33-b91c-f1fb56019b3a => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] VM Started (Lifecycle Event)
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Took 7.95 seconds to spawn the instance on the hypervisor.
Sep 04 23:48:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:47 user nova-compute[72954]: INFO nova.compute.manager [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Took 9.25 seconds to build instance.
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8e584c28-67fb-4e8d-9529-a7c56282890d tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.705s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEJohDgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:48 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:48 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:48 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:48:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance spawned successfully.
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[265414b2-fd83-4e46-9691-b075991e73ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:48:48 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871328.1582935, ea7bdfdb-4756-44cc-8303-c9333e801500 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:48:48 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Resumed (Lifecycle Event)
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007e884-5f14-4204-a33b-56194ced07d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3] added
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:48 user nova-compute[72954]: WARNING nova.compute.manager [req-06fb4068-9011-403e-834c-e5a1811337c8 req-2389f05a-bd62-4f50-845e-9d9fc490b73c service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state shelved_offloaded and task_state spawning.
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.082s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8c432-df70-48be-a0d3-778420263598]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce47ad7e-235e-4615-b51d-28873252ca5e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEJohDgK {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871328.1585927, ea7bdfdb-4756-44cc-8303-c9333e801500 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:48:48 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Started (Lifecycle Event)
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEJohDgK" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7b28d-84d6-4cc6-bcf9-57cedcd14731]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEJohDgK'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc5997-be79-4da0-9792-d9d80e9a585d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc97eb-5238-4934-9280-4f0ca0b9bd49]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ccae4-84d5-4169-9c61-496b4f453ff2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260]
Sep 04 23:48:48 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c24a2-c526-48bd-ab02-e39c71744863]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c1d7c-02c1-4036-8242-806a30c041a5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b2ca56-13e8-4d89-9f5f-1df3a59a4aaf]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-dd21343e-88e6-491a-adad-c903435945bc tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.421s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEJohDgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== connect_volume: return (1544ms) {'type': 'block', 'scsi_wwn': '23062656262393835', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062656262393835', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:48:49 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:49 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:48:49 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:48:49 user nova-compute[72954]:   <serial>39753e2e-53da-451e-b0cd-b7e12c5286c3</serial>
Sep 04 23:48:49 user nova-compute[72954]: </disk>
Sep 04 23:48:49 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871315.0388386, 2bab57e0-c079-4701-9d61-7dd1a050068c => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:48:50 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] VM Stopped (Lifecycle Event)
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1f15df3f-cf46-467b-92ac-4d2ebb8613b2 None None] [instance: 2bab57e0-c079-4701-9d61-7dd1a050068c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] No VIF found with MAC fa:16:3e:26:e9:16, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:48:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-041616dd-a50c-4a12-8453-a3176dfe2db9 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.903s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:51 user nova-compute[72954]: INFO nova.compute.manager [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Detaching volume 37e673c8-9bcc-476c-bf85-79d5b39ff711
Sep 04 23:48:52 user nova-compute[72954]: INFO nova.virt.block_device [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attempting to driver detach volume 37e673c8-9bcc-476c-bf85-79d5b39ff711 from mountpoint /dev/vdb
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Attempting to detach device vdb from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:52 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:52 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:48:52 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:52 user nova-compute[72954]:   <serial>37e673c8-9bcc-476c-bf85-79d5b39ff711</serial>
Sep 04 23:48:52 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:48:52 user nova-compute[72954]: </disk>
Sep 04 23:48:52 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdb from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the persistent domain config.
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:52 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:52 user nova-compute[72954]:   <source dev="/dev/sde"/>
Sep 04 23:48:52 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:48:52 user nova-compute[72954]:   <serial>37e673c8-9bcc-476c-bf85-79d5b39ff711</serial>
Sep 04 23:48:52 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:48:52 user nova-compute[72954]: </disk>
Sep 04 23:48:52 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871332.6071963, 75e269bc-f74f-4233-a59a-729b927f1652 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:48:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdb from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the live domain config.
Sep 04 23:48:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rjsgypHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:52 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79be9ca-acb7-4f71-b696-7758e07a115a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f0c8d1-dba9-46ae-b131-d1b7b8dd70c2]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:52 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130229360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711'): ({'sde'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Removing single pathed devices sde {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c46ab-e430-4164-953c-c58a428cdc72]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae38dda-5aca-4f92-b4b5-ee117fe8a20d]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flushing IO for device /dev/sde {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f451ebb-b535-4855-8e3f-a907c6f96279]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116e1cf-7797-4658-9cf5-1da48eb16a91]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] SCSI volumes sde have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79a96f-d91a-4600-996f-ce3664db16b4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.165s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228831f-3de9-41bf-a683-3438d5340421]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260]
Sep 04 23:48:53 user nova-compute[72954]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:53 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e673c8-9bcc-476c-bf85-79d5b39ff711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c227b06-bb78-441a-8894-b896a166c524]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== disconnect_volume: return (505ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:48:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-41629636-7ba2-4c06-a8f3-62aa88fa5182 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.231s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:54 user nova-compute[72954]: INFO nova.compute.manager [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Detaching volume 39753e2e-53da-451e-b0cd-b7e12c5286c3
Sep 04 23:48:54 user nova-compute[72954]: INFO nova.virt.block_device [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Attempting to driver detach volume 39753e2e-53da-451e-b0cd-b7e12c5286c3 from mountpoint /dev/vdc
Sep 04 23:48:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Attempting to detach device vdc from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:54 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:54 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:48:54 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:48:54 user nova-compute[72954]:   <serial>39753e2e-53da-451e-b0cd-b7e12c5286c3</serial>
Sep 04 23:48:54 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:48:54 user nova-compute[72954]: </disk>
Sep 04 23:48:54 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdc from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the persistent domain config.
Sep 04 23:48:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:48:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:48:54 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:48:54 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:48:54 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:48:54 user nova-compute[72954]:   <serial>39753e2e-53da-451e-b0cd-b7e12c5286c3</serial>
Sep 04 23:48:54 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:48:54 user nova-compute[72954]: </disk>
Sep 04 23:48:54 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871335.2412317, 75e269bc-f74f-4233-a59a-729b927f1652 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:48:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully detached device vdc from instance 75e269bc-f74f-4233-a59a-729b927f1652 from the live domain config.
Sep 04 23:48:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEJohDgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:48:55 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1121fe3-9080-4c67-82c7-fea245105d0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a3bae-f4e7-4e8f-9334-81a70a237daa]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:55 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:55 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:48:55 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:48:55 user nova-compute[72954]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 (non-flash)
Sep 04 23:48:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1181dadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce9c4b-ac5d-43d5-9556-029e8e8c7c09]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b69fc84-6bc2-433d-abc6-9e5f1ec5ae7e]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a986e5-996c-476f-9bd2-8c97185c1c93]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386f756-569f-4462-bbd3-13321b3c9d0c]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608d0d2-5b9d-478e-aa4b-f91da15f824e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd561b24-7159-415b-8a98-2f8fd44df1ab]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260]
Sep 04 23:48:55 user nova-compute[72954]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3, portal: 172.16.0.220,3260] successful.
Sep 04 23:48:55 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39753e2e-53da-451e-b0cd-b7e12c5286c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49ba723-d1de-4dcc-8411-924959095206]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] <== disconnect_volume: return (353ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:48:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:48:56 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'flavor' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a46884c1-fcc6-47ce-af96-85af6e793cc5 tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.019s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:57 user nova-compute[72954]: INFO nova.compute.manager [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Terminating instance
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-unplugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] No waiting events found dispatching network-vif-unplugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-33e4783e-bca6-43d4-a73f-2933c12708de req-82e9ce14-b3d5-4a86-ac86-fa605d48dcb7 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-unplugged-bbe133bb-92bc-4c89-9dff-c1d034430830 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:48:57 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Instance destroyed successfully.
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lazy-loading 'resources' on Instance uuid 75e269bc-f74f-4233-a59a-729b927f1652 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1860626477',display_name='tempest-AttachVolumeTestJSON-server-1860626477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1860626477',id=34,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFRNcLx2/F732z375QS/ZuNgWNTwiG4nZq8Xhyg+B9tmI4lbhwUbRSnReglz9H/AjMRx+ojRP7i/hzH/P60BJc/lFI9dV+YJOcBIXF9C9eAq/0nHsHRx/cqJtupPOEEbQ==',key_name='tempest-keypair-1522777488',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9857524a888d4d9f9d3e48341500411a',ramdisk_id='',reservation_id='r-ke30losl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-79448822',owner_user_name='tempest-AttachVolumeTestJSON-79448822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c3ec932cc64d98a8b1b6c10dd6f432',uuid=75e269bc-f74f-4233-a59a-729b927f1652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converting VIF {"id": "bbe133bb-92bc-4c89-9dff-c1d034430830", "address": "fa:16:3e:26:e9:16", "network": {"id": "45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1182123486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9857524a888d4d9f9d3e48341500411a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe133bb-92", "ovs_interfaceid": "bbe133bb-92bc-4c89-9dff-c1d034430830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:48:57 user nova-compute[72954]: DEBUG os_vif [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbe133bb-92, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:48:58 user nova-compute[72954]: INFO os_vif [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:e9:16,bridge_name='br-int',has_traffic_filtering=True,id=bbe133bb-92bc-4c89-9dff-c1d034430830,network=Network(45a8ed6f-b3fb-4cba-9391-c9fcf0ba996e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe133bb-92')
Sep 04 23:48:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Deleting instance files /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652_del
Sep 04 23:48:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Deletion of /opt/stack/data/nova/instances/75e269bc-f74f-4233-a59a-729b927f1652_del complete
Sep 04 23:48:58 user nova-compute[72954]: INFO nova.compute.manager [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Took 0.89 seconds to destroy the instance on the hypervisor.
Sep 04 23:48:58 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:48:58 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Took 0.80 seconds to deallocate network for instance.
Sep 04 23:48:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-1c64d81b-175a-42f3-9fba-a4c2f705955b req-5f27c187-632b-4262-b1de-04b7daabe8d0 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-deleted-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:59 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Deleted allocations for instance 75e269bc-f74f-4233-a59a-729b927f1652
Sep 04 23:48:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d5fdf802-2598-456a-9bc5-fce19a950acd tempest-AttachVolumeTestJSON-79448822 tempest-AttachVolumeTestJSON-79448822-project-member] Lock "75e269bc-f74f-4233-a59a-729b927f1652" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] Acquiring lock "75e269bc-f74f-4233-a59a-729b927f1652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] Lock "75e269bc-f74f-4233-a59a-729b927f1652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:48:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] No waiting events found dispatching network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:48:59 user nova-compute[72954]: WARNING nova.compute.manager [req-c7e93e9b-7907-411b-864d-bc77fdabba44 req-28cb279b-034e-4538-a0c1-fe170a4e8cf5 service nova] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Received unexpected event network-vif-plugged-bbe133bb-92bc-4c89-9dff-c1d034430830 for instance with vm_state deleted and task_state None.
Sep 04 23:49:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:11 user nova-compute[72954]: INFO nova.compute.manager [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Detaching volume bd39b428-a6af-4046-b540-5cb9ea65eddf
Sep 04 23:49:11 user nova-compute[72954]: INFO nova.virt.block_device [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Attempting to driver detach volume bd39b428-a6af-4046-b540-5cb9ea65eddf from mountpoint /dev/vdb
Sep 04 23:49:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Attempting to detach device vdb from instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:49:11 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:49:11 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:49:11 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:49:11 user nova-compute[72954]:   <serial>bd39b428-a6af-4046-b540-5cb9ea65eddf</serial>
Sep 04 23:49:11 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:49:11 user nova-compute[72954]: </disk>
Sep 04 23:49:11 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:49:11 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully detached device vdb from instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 from the persistent domain config.
Sep 04 23:49:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:49:11 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:49:11 user nova-compute[72954]:   <source dev="/dev/sdd"/>
Sep 04 23:49:11 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:49:11 user nova-compute[72954]:   <serial>bd39b428-a6af-4046-b540-5cb9ea65eddf</serial>
Sep 04 23:49:11 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:49:11 user nova-compute[72954]: </disk>
Sep 04 23:49:11 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:49:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871352.1406875, ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:49:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully detached device vdb from instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 from the live domain config.
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVXWuDoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:49:12 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7020b747-4ac5-4ee5-a690-a25e9e49fb9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1c963-9b7b-4ddb-abe6-42cc5d59fdeb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:49:12 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:12 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf (non-flash)
Sep 04 23:49:12 user nova-compute[72954]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:12 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11836ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b8506-6e4e-44a7-9b92-dac494f061ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc0dd0-a377-4fb8-8629-0deb9a745a43]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9404a-c9a4-4534-bdbc-39f7475e356d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a9ada3-d86c-4333-9095-b05ea027724b]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48f7cf-24a7-4582-ad45-8067b45da936]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7578524-5e71-4e74-bdbc-cf63d4b22940]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260]
Sep 04 23:49:12 user nova-compute[72954]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf, portal: 172.16.0.220,3260] successful.
Sep 04 23:49:12 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea67849-8df3-4c28-87f9-042770a1514d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== disconnect_volume: return (315ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871337.9721003, 75e269bc-f74f-4233-a59a-729b927f1652 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:49:12 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] VM Stopped (Lifecycle Event)
Sep 04 23:49:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-cbf0da1d-e404-44ff-a3d9-6524d885fe8f None None] [instance: 75e269bc-f74f-4233-a59a-729b927f1652] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'flavor' on Instance uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8a827f37-7f6c-4d13-9471-eeb8c1a2d60f tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.604s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:13 user nova-compute[72954]: INFO nova.compute.manager [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Terminating instance
Sep 04 23:49:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-unplugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] No waiting events found dispatching network-vif-unplugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:49:13 user nova-compute[72954]: DEBUG nova.compute.manager [req-b933cfec-77ab-4596-af83-15b4f89a19e8 req-ccbb506f-680b-49f4-a5bc-373d80cbb263 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-unplugged-465d9522-f495-4581-8eff-4b39422477e2 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Instance destroyed successfully.
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lazy-loading 'resources' on Instance uuid ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-729409747',display_name='tempest-VolumesSnapshotTestJSON-instance-729409747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-729409747',id=33,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnW9vVDa4QUli4+4rGWpU5u70C1/VoV4LV1uZBtpm9wr+EClMgh3mkhgbcu6MSU65180vtyX0n1GjFADN1Jethr/NxOSX3EIS/GPPRZ6fRkLsLo5alPWv/+TDKg3JHL3A==',key_name='tempest-keypair-660078741',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed107bda33f4121b93cdae99b20b44b',ramdisk_id='',reservation_id='r-xondjyhe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-104452992',owner_user_name='tempest-VolumesSnapshotTestJSON-104452992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa79abd0fdf546209e803129a014193e',uuid=ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converting VIF {"id": "465d9522-f495-4581-8eff-4b39422477e2", "address": "fa:16:3e:fd:bb:ee", "network": {"id": "ecf63ffe-e637-4190-aecb-13b79badb9ae", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-150687862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed107bda33f4121b93cdae99b20b44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465d9522-f4", "ovs_interfaceid": "465d9522-f495-4581-8eff-4b39422477e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_vif [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465d9522-f4, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:49:14 user nova-compute[72954]: INFO os_vif [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:bb:ee,bridge_name='br-int',has_traffic_filtering=True,id=465d9522-f495-4581-8eff-4b39422477e2,network=Network(ecf63ffe-e637-4190-aecb-13b79badb9ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465d9522-f4')
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVXWuDoG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:49:14 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd39b428-a6af-4046-b540-5cb9ea65eddf', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4463d370-8280-47bf-881b-b53e7000d3a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee4636-0957-4ffb-bdfd-fe8eb5b2090b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:14 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:14 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1380b28c0>, {}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Disconnecting from: [] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] <== disconnect_volume: return (52ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:49:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Deleting instance files /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131_del
Sep 04 23:49:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Deletion of /opt/stack/data/nova/instances/ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131_del complete
Sep 04 23:49:14 user nova-compute[72954]: INFO nova.compute.manager [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Took 0.97 seconds to destroy the instance on the hypervisor.
Sep 04 23:49:14 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:49:15 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Took 1.33 seconds to deallocate network for instance.
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-ab1af5c5-0bfa-479d-ab86-313aa20d02d2 req-8dae261d-d7e4-4a32-bc92-4df3375c2549 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-deleted-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:15 user nova-compute[72954]: WARNING nova.volume.cinder [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Attachment 3a496221-bd88-4253-9555-5e5edf52691f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3a496221-bd88-4253-9555-5e5edf52691f. (HTTP 404) (Request-ID: req-54073330-0a5d-4740-9276-ecfe62c3a551)
Sep 04 23:49:15 user nova-compute[72954]: INFO nova.compute.manager [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Took 0.02 seconds to detach 1 volumes for instance.
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] Acquiring lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] No waiting events found dispatching network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:49:15 user nova-compute[72954]: WARNING nova.compute.manager [req-f8efd401-c2da-429e-a5fb-b41a8fefdf90 req-c0e395cf-bc78-4c56-948a-8b413b26bc15 service nova] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Received unexpected event network-vif-plugged-465d9522-f495-4581-8eff-4b39422477e2 for instance with vm_state active and task_state deleting.
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:49:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:16 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Deleted allocations for instance ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131
Sep 04 23:49:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-21df7a75-5ead-4ceb-b2aa-8f4aec8365bd tempest-VolumesSnapshotTestJSON-104452992 tempest-VolumesSnapshotTestJSON-104452992-project-member] Lock "ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:16 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:49:19 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:49:19 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=25.27132797241211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ea7bdfdb-4756-44cc-8303-c9333e801500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:49:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG nova.objects.instance [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:20 user nova-compute[72954]: INFO nova.compute.manager [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attaching volume 06132733-7959-42fa-8ad7-2eb1eb324680 to /dev/vdb
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.utils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5c0073-8723-40af-b842-6fd4e0dd6da6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4414b54-58b6-41de-84a1-e54db34721da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b81b2-60d2-4f56-9fd7-2c712a28b61c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215f8a9-c84e-458a-b561-99cfaf268dec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:49:20 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:49:20 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec5b7b3-b807-47ca-a753-99e2b6923d44]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG os_brick.utils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:49:20 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating existing volume attachment record: 0e38e496-734b-4036-acb3-0ed3ff071614 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:49:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871354.1278763, ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:49:29 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] VM Stopped (Lifecycle Event)
Sep 04 23:49:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9e9bacec-9332-4ea0-a83a-120cd3ef35fa None None] [instance: ce8d0da2-6a73-4c9d-96d2-7aaf11bdc131] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:49:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:49:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:49:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid d57a3389-b5ab-4dc3-8729-6e87085a4e54 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [{"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-d57a3389-b5ab-4dc3-8729-6e87085a4e54" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:49:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:33 user nova-compute[72954]: INFO nova.compute.manager [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Terminating instance
Sep 04 23:49:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-unplugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] No waiting events found dispatching network-vif-unplugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.compute.manager [req-c93b74c0-71d3-4d54-88e2-62ea0da8dad1 req-3013aa1c-5a1f-46d8-b81e-8a88fae3f5ab service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-unplugged-cbea434f-2c70-48bf-a272-430d03d91514 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Instance destroyed successfully.
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lazy-loading 'resources' on Instance uuid d57a3389-b5ab-4dc3-8729-6e87085a4e54 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1700502807',display_name='tempest-ServerActionsTestOtherA-server-1700502807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1700502807',id=5,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTF69URIasy5F2hKVzSqPQVLHRudNGQxEfsVHsDOzFD2arI7h1VYqicGOerLZQ/6WXP1sRkbAGpDCiUDb1xtqvm0ejgCg6DBuGg41z5ZfL1u2eJTa/tOLCBK8u6Lhtltw==',key_name='tempest-keypair-1515033878',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c2f8d4f90e74533b0f0b96581c8bd5a',ramdisk_id='',reservation_id='r-bams1gld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-520106611',owner_user_name='tempest-ServerActionsTestOtherA-520106611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3694a9f4359a487db80ec71c526201be',uuid=d57a3389-b5ab-4dc3-8729-6e87085a4e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converting VIF {"id": "cbea434f-2c70-48bf-a272-430d03d91514", "address": "fa:16:3e:44:15:44", "network": {"id": "731e028e-829f-4302-81ab-b8e6e649fc00", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-356622181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c2f8d4f90e74533b0f0b96581c8bd5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbea434f-2c", "ovs_interfaceid": "cbea434f-2c70-48bf-a272-430d03d91514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG os_vif [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbea434f-2c, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:49:34 user nova-compute[72954]: INFO os_vif [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:15:44,bridge_name='br-int',has_traffic_filtering=True,id=cbea434f-2c70-48bf-a272-430d03d91514,network=Network(731e028e-829f-4302-81ab-b8e6e649fc00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbea434f-2c')
Sep 04 23:49:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Deleting instance files /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54_del
Sep 04 23:49:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Deletion of /opt/stack/data/nova/instances/d57a3389-b5ab-4dc3-8729-6e87085a4e54_del complete
Sep 04 23:49:34 user nova-compute[72954]: INFO nova.compute.manager [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Took 0.90 seconds to destroy the instance on the hypervisor.
Sep 04 23:49:34 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:49:34 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:49:35 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Took 0.56 seconds to deallocate network for instance.
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-77ecf3c9-46f0-4191-aaaf-7fbb3d7644a8 req-4914c932-9751-4310-ad06-27fd8d376bb5 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-deleted-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:35 user nova-compute[72954]: INFO nova.compute.manager [req-77ecf3c9-46f0-4191-aaaf-7fbb3d7644a8 req-4914c932-9751-4310-ad06-27fd8d376bb5 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Neutron deleted interface cbea434f-2c70-48bf-a272-430d03d91514; detaching it from the instance and deleting it from the info cache
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-77ecf3c9-46f0-4191-aaaf-7fbb3d7644a8 req-4914c932-9751-4310-ad06-27fd8d376bb5 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-77ecf3c9-46f0-4191-aaaf-7fbb3d7644a8 req-4914c932-9751-4310-ad06-27fd8d376bb5 service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Detach interface failed, port_id=cbea434f-2c70-48bf-a272-430d03d91514, reason: Instance d57a3389-b5ab-4dc3-8729-6e87085a4e54 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZVNnoSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:49:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:49:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:49:35 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91faea-3cc6-49f9-90ef-cb72777590b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:49:35 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a046230-c880-486f-a0d1-3e31d579a82a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680] added
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0e94d-f80d-465b-b72b-c0cdf958e78d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ef469-3a4d-49e5-9cfa-40102f019d52]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZVNnoSv {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZVNnoSv" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2d53e-75f6-4d5c-8789-d71e115042af]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZVNnoSv'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef148f2-b198-425e-82b3-70ddc350c9fb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4bc5d-bf96-4d60-b0ff-b7e926e86388]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c635dfd-f75b-4c54-a1ce-17407d85e8ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260]
Sep 04 23:49:35 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260] successful.
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Deleted allocations for instance d57a3389-b5ab-4dc3-8729-6e87085a4e54
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd2551f-b1d8-4c09-b351-60b8ef493dc3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba1363-0fb3-4bbb-bdae-db74720197b9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)
Sep 04 23:49:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[09475cc2-3cf8-456d-995b-ac04c49d3b4d]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZVNnoSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:49:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c1aa0618-86a4-4233-bc1a-9c3a3527d7d4 tempest-ServerActionsTestOtherA-520106611 tempest-ServerActionsTestOtherA-520106611-project-member] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] Acquiring lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] Lock "d57a3389-b5ab-4dc3-8729-6e87085a4e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] No waiting events found dispatching network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:49:36 user nova-compute[72954]: WARNING nova.compute.manager [req-e7690b0f-344c-4f8a-9065-38ca25d00b04 req-32de91e5-356e-460c-8bee-3111c227114e service nova] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Received unexpected event network-vif-plugged-cbea434f-2c70-48bf-a272-430d03d91514 for instance with vm_state deleted and task_state None.
Sep 04 23:49:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26266316263313139', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266316263313139', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.objects.instance [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:49:36 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:49:36 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:49:36 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:49:36 user nova-compute[72954]:   <serial>06132733-7959-42fa-8ad7-2eb1eb324680</serial>
Sep 04 23:49:36 user nova-compute[72954]: </disk>
Sep 04 23:49:36 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:49:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No VIF found with MAC fa:16:3e:4c:76:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:49:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-37ddd0ea-23ed-4e01-a9f8-9e7bb6d37c4f tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.460s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:49:39 user nova-compute[72954]: INFO nova.compute.manager [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Detaching volume 06132733-7959-42fa-8ad7-2eb1eb324680
Sep 04 23:49:39 user nova-compute[72954]: INFO nova.virt.block_device [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attempting to driver detach volume 06132733-7959-42fa-8ad7-2eb1eb324680 from mountpoint /dev/vdb
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Attempting to detach device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:49:39 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:49:39 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:49:39 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:49:39 user nova-compute[72954]:   <serial>06132733-7959-42fa-8ad7-2eb1eb324680</serial>
Sep 04 23:49:39 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:49:39 user nova-compute[72954]: </disk>
Sep 04 23:49:39 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:49:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config.
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:49:39 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:49:39 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:49:39 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:49:39 user nova-compute[72954]:   <serial>06132733-7959-42fa-8ad7-2eb1eb324680</serial>
Sep 04 23:49:39 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:49:39 user nova-compute[72954]: </disk>
Sep 04 23:49:39 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871379.8850985, 29c1b984-b059-4a9c-8137-59391b5990bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:49:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config.
Sep 04 23:49:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZVNnoSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:49:39 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[657efff9-5722-4270-86ca-de3c6e4515df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26620f85-09ae-4b4f-a2f2-62d6033180cb]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:39 user nova-compute[72954]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)
Sep 04 23:49:39 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:49:39 user nova-compute[72954]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 (non-flash)
Sep 04 23:49:39 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1301bf6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c30090e-68b6-42f7-a110-f339ca360330]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c76c4f-edf2-4615-ad41-b434a111c66a]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:49:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3f599-28f6-450e-a04e-5250ade6db2b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c896c0d0-a1f4-48b4-9734-6ab0fd9b89c0]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[53713cc3-c66c-4d37-bace-35f119287889]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1969f24c-1797-4790-a9aa-fdefc95d8882]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260]
Sep 04 23:49:40 user nova-compute[72954]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680, portal: 172.16.0.220,3260] successful.
Sep 04 23:49:40 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06132733-7959-42fa-8ad7-2eb1eb324680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e808b-06bb-484e-9795-bbadf43dec46]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== disconnect_volume: return (262ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:49:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:49:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-75dbc1b0-86b3-43d0-b409-3aaf5fa3cf0d tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.693s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:49:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:49 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871374.4417503, d57a3389-b5ab-4dc3-8729-6e87085a4e54 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:49:49 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] VM Stopped (Lifecycle Event)
Sep 04 23:49:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9a6abcfc-e220-4923-8ace-17766c2660ba None None] [instance: d57a3389-b5ab-4dc3-8729-6e87085a4e54] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:49:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:49:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:49:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:50:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:04 user nova-compute[72954]: INFO nova.compute.manager [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Detaching volume 728375eb-dd81-427d-abb5-f243ac726305
Sep 04 23:50:05 user nova-compute[72954]: INFO nova.virt.block_device [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Attempting to driver detach volume 728375eb-dd81-427d-abb5-f243ac726305 from mountpoint /dev/vdc
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Attempting to detach device vdc from instance ea7bdfdb-4756-44cc-8303-c9333e801500 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:50:05 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:50:05 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:50:05 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:50:05 user nova-compute[72954]:   <serial>728375eb-dd81-427d-abb5-f243ac726305</serial>
Sep 04 23:50:05 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:50:05 user nova-compute[72954]: </disk>
Sep 04 23:50:05 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:50:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully detached device vdc from instance ea7bdfdb-4756-44cc-8303-c9333e801500 from the persistent domain config.
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ea7bdfdb-4756-44cc-8303-c9333e801500 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:50:05 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:50:05 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:50:05 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:50:05 user nova-compute[72954]:   <serial>728375eb-dd81-427d-abb5-f243ac726305</serial>
Sep 04 23:50:05 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Sep 04 23:50:05 user nova-compute[72954]: </disk>
Sep 04 23:50:05 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871405.5389447, ea7bdfdb-4756-44cc-8303-c9333e801500 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:50:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully detached device vdc from instance ea7bdfdb-4756-44cc-8303-c9333e801500 from the live domain config.
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXZSiljM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:50:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b6ba2-3271-4bc8-b5a6-ed2b2ac6575d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc563e-e8c0-4c49-ad8e-d4b2ccaa37da]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:50:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 (non-flash)
Sep 04 23:50:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1184cfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[017858ed-eef5-4a69-afb0-00dc82b81c70]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841e43d-4693-4b21-be96-49d3f671dea1]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd34c4-c79e-4d51-9c65-d6033a7ce923]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd4d15-af6a-468c-8a29-572270f8a5f2]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11546ddf-f1f5-45c1-ae13-44d33dfe9599]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae18390-9fcb-4f05-86ed-4ded473f50b1]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260]
Sep 04 23:50:05 user nova-compute[72954]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305, portal: 172.16.0.220,3260] successful.
Sep 04 23:50:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:728375eb-dd81-427d-abb5-f243ac726305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99febe7c-d544-4914-952b-004c40cf9892]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] <== disconnect_volume: return (268ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:50:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:50:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'flavor' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:50:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f63a3da-112e-4c2b-ba85-277edc7797b7 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:18 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:19 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:50:20 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=25.287906646728516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ea7bdfdb-4756-44cc-8303-c9333e801500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:50:20 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:50:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:50:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:50:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-changed-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Refreshing instance network info cache due to event network-changed-3e19dddb-1a75-4349-8c64-5a8033a534ea. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] Acquiring lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] Acquired lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Refreshing network info cache for port 3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:50:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:50:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updated VIF entry in instance network info cache for port 3e19dddb-1a75-4349-8c64-5a8033a534ea. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:50:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updating instance_info_cache with network_info: [{"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:50:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-86eb6734-1809-4b8e-bf06-8afd2555b5b9 req-f7dae334-6104-417c-a267-df0b48eb88c7 service nova] Releasing lock "refresh_cache-45e0a0aa-766f-4c33-b91c-f1fb56019b3a" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:50:31 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:50:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [{"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:50:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-ea7bdfdb-4756-44cc-8303-c9333e801500" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:50:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:50:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:50:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lazy-loading 'flavor' on Instance uuid 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:38 user nova-compute[72954]: INFO nova.compute.manager [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Attaching volume 47fd75f2-1f7b-45f7-9791-c94e39d8436c to /dev/vdb
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.utils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c38fdb-37d7-4418-a2c4-dcd41e8c243f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df008e-e3f7-4e13-bc92-6991e013962a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[355ab8d6-01b5-46da-937e-5a7d6f69fc8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c14b68-f3b8-4b5b-a509-d51336532a5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:50:38 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:50:38 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c99cf51-f8ab-48a1-a7ad-d56e622bca18]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG os_brick.utils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:50:38 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updating existing volume attachment record: 8d47710f-99b1-4d01-b3e9-f12cc3ffccfa {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:39 user nova-compute[72954]: INFO nova.compute.manager [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attaching volume 4d38da95-d36d-4f5b-a450-2da4a2d1ac19 to /dev/vdb
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.utils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f256e-39a4-43de-a100-f908edbc87f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb24e1-85a9-4504-abac-fdb5f2477e87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a031265f-c00a-443d-850f-283f5f03ce70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[68765885-d954-4b4e-9374-fcc7729d47db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:50:39 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:50:39 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5a800-b713-4ede-9422-edbcbc549492]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG os_brick.utils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:50:39 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating existing volume attachment record: 4e7375a2-3cd3-43ee-9cb4-051757a66c0c {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:50:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:50:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:55 user nova-compute[72954]: INFO nova.compute.manager [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Terminating instance
Sep 04 23:50:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.compute.manager [req-fd8a4a0c-1b43-453d-a990-3fefef35a691 req-f4e6ac08-c608-4c2a-940e-0910af0403f3 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-unplugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Instance destroyed successfully.
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.objects.instance [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'resources' on Instance uuid ea7bdfdb-4756-44cc-8303-c9333e801500 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:44:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2111222641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2111222641',id=31,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuGVgFqlIh8+IeKUWFcplbdBivrDYPQzPemw/oL4Rp+Sfl/aj2hhXsiqkRCSEpRKc5LQFlA1LzQuMGC7AzJHBmOTvv5GBnY3xV/4X1ozfX0qefSZFnFQcUvnyxRUXC13Q==',key_name='tempest-keypair-1273442277',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-o75ylcyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ea7bdfdb-4756-44cc-8303-c9333e801500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "9b466066-4269-4d95-97ea-b349d70475bc", "address": "fa:16:3e:cf:b2:6d", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b466066-42", "ovs_interfaceid": "9b466066-4269-4d95-97ea-b349d70475bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG os_vif [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b466066-42, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:50:56 user nova-compute[72954]: INFO os_vif [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:b2:6d,bridge_name='br-int',has_traffic_filtering=True,id=9b466066-4269-4d95-97ea-b349d70475bc,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b466066-42')
Sep 04 23:50:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Deleting instance files /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500_del
Sep 04 23:50:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Deletion of /opt/stack/data/nova/instances/ea7bdfdb-4756-44cc-8303-c9333e801500_del complete
Sep 04 23:50:56 user nova-compute[72954]: INFO nova.compute.manager [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Took 0.97 seconds to destroy the instance on the hypervisor.
Sep 04 23:50:56 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:50:56 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrpekZPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:50:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:50:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:50:57 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9763f17-41a3-4a3a-a4c1-5b5b213e0ef4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:50:57 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa3459-cd0a-4c9a-ae5e-f7afb7e60acc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c] added
Sep 04 23:50:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff0958-e570-459d-bdb0-0a0024a2922d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489e7f3-2c16-43b9-98cd-72d6df4233d6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrpekZPo {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrpekZPo" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b1729-87ca-4983-b57b-4076744aa152]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IrpekZPo'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf31d3-aed8-413e-bda7-ba5c6bd86a1c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d494af00-6fcc-4450-b2c8-76e0254b8a54]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:50:57 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:50:57 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:50:57 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:50:57 user nova-compute[72954]: 
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790bb89-aedc-45d7-9968-ec09a245a1e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260]
Sep 04 23:50:57 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260] successful.
Sep 04 23:50:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.106s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[508cd9ad-c442-49ed-b78f-592f6c27b7e3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4645b-5a51-4c94-b918-62c2c0238770]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)
Sep 04 23:50:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)
Sep 04 23:50:57 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a48f08-5c3a-43fd-bd1f-806010d2f381]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:50:57 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Took 1.09 seconds to deallocate network for instance.
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-122e34b7-006c-4a69-afc2-468e905085df req-ebf7d99d-1e81-4292-aa86-e53624e6c781 service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-deleted-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] Acquiring lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.compute.manager [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] No waiting events found dispatching network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:50:58 user nova-compute[72954]: WARNING nova.compute.manager [req-881da0e1-1b50-4c3b-a7bb-5d29450f40e6 req-a07a516d-71cc-45fd-b6af-b954aa51b51d service nova] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Received unexpected event network-vif-plugged-9b466066-4269-4d95-97ea-b349d70475bc for instance with vm_state deleted and task_state None.
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:58 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Deleted allocations for instance ea7bdfdb-4756-44cc-8303-c9333e801500
Sep 04 23:50:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6a4b81a5-2197-48a1-826e-e1d18b2353ad tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ea7bdfdb-4756-44cc-8303-c9333e801500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrpekZPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26131356337326238', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131356337326238', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lazy-loading 'flavor' on Instance uuid 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:50:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:50:58 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:50:58 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:50:58 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:50:58 user nova-compute[72954]:   <serial>47fd75f2-1f7b-45f7-9791-c94e39d8436c</serial>
Sep 04 23:50:58 user nova-compute[72954]: </disk>
Sep 04 23:50:58 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:50:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:50:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:50:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] No VIF found with MAC fa:16:3e:53:c2:5b, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:50:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c6c0b1a7-5141-439e-a153-6f44f6cb4cf1 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.998s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:01 user nova-compute[72954]: INFO nova.compute.manager [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Detaching volume 47fd75f2-1f7b-45f7-9791-c94e39d8436c
Sep 04 23:51:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:01 user nova-compute[72954]: INFO nova.virt.block_device [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Attempting to driver detach volume 47fd75f2-1f7b-45f7-9791-c94e39d8436c from mountpoint /dev/vdb
Sep 04 23:51:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Attempting to detach device vdb from instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:51:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:51:01 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:51:01 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:51:01 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:51:01 user nova-compute[72954]:   <serial>47fd75f2-1f7b-45f7-9791-c94e39d8436c</serial>
Sep 04 23:51:01 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:51:01 user nova-compute[72954]: </disk>
Sep 04 23:51:01 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:51:01 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Successfully detached device vdb from instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a from the persistent domain config.
Sep 04 23:51:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:51:01 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:51:01 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:51:01 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:51:01 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:51:01 user nova-compute[72954]:   <serial>47fd75f2-1f7b-45f7-9791-c94e39d8436c</serial>
Sep 04 23:51:01 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:51:01 user nova-compute[72954]: </disk>
Sep 04 23:51:01 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871462.1367466, 45e0a0aa-766f-4c33-b91c-f1fb56019b3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:51:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Successfully detached device vdb from instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a from the live domain config.
Sep 04 23:51:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrpekZPo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:51:02 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dcecfe-9186-4f97-a893-a3dd237c6dbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ec1073-abb3-41f3-a430-325500c2003b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)
Sep 04 23:51:02 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c (non-flash)
Sep 04 23:51:02 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13811f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d35989-3cb1-4711-b8c2-334c646097ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79c373-8768-4077-92ca-51d07669599b]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77854608-b306-4618-bf2d-dd44363d08ab]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fe0d6-5f0c-49af-b93c-cb520987d33f]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a58423-2661-4b97-8c42-38828ce06ba7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1fbf06-56f4-49aa-b2dd-abb4c77fb1bf]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260]
Sep 04 23:51:02 user nova-compute[72954]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c, portal: 172.16.0.220,3260] successful.
Sep 04 23:51:02 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fd75f2-1f7b-45f7-9791-c94e39d8436c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed2087-440d-4edc-81df-5954c6624d62]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] <== disconnect_volume: return (287ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:51:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:51:03 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lazy-loading 'flavor' on Instance uuid 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:51:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9e121722-ff23-43b7-9446-79fa078bbe63 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.983s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDMeYzmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:51:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:51:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:51:08 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c45b5-f72f-4fb1-b56b-c3ca7f479a86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:51:08 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafbf0e5-ea93-4f3c-a800-3a5397c21dcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19] added
Sep 04 23:51:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9328a60d-49c8-4da0-b876-958c04e793e3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b5e12-15d2-4ef0-ba92-29ed1a1b4b60]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDMeYzmV {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDMeYzmV" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c31a76-1009-4f4f-9d28-428a8474eb7d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UDMeYzmV'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[08095615-69b4-4662-89b0-3d8331d7a7f2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98621c8-d279-40a5-a54a-765f894cbda0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:51:09 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:51:09 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:51:09 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:51:09 user nova-compute[72954]: 
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46b623-cd59-4983-9c3f-02d84242b6da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260]
Sep 04 23:51:09 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260] successful.
Sep 04 23:51:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccab879-29e0-4d50-90ca-fae0e888b48a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[19768592-6563-4714-a094-0f861c4d828f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)
Sep 04 23:51:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)
Sep 04 23:51:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe58af3-923b-467c-bab9-db3b0e801a69]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDMeYzmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26534633034396332', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534633034396332', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.objects.instance [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:51:10 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:51:10 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:51:10 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:51:10 user nova-compute[72954]:   <serial>4d38da95-d36d-4f5b-a450-2da4a2d1ac19</serial>
Sep 04 23:51:10 user nova-compute[72954]: </disk>
Sep 04 23:51:10 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No VIF found with MAC fa:16:3e:4c:76:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:51:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70cbd9c4-7205-47db-a5b9-cc28a14748ef tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.455s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:11 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871456.5158918, ea7bdfdb-4756-44cc-8303-c9333e801500 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:51:11 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] VM Stopped (Lifecycle Event)
Sep 04 23:51:11 user nova-compute[72954]: DEBUG nova.compute.manager [None req-1d3713df-0196-4e61-abf0-7e035b512635 None None] [instance: ea7bdfdb-4756-44cc-8303-c9333e801500] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:12 user nova-compute[72954]: INFO nova.compute.manager [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Detaching volume 4d38da95-d36d-4f5b-a450-2da4a2d1ac19
Sep 04 23:51:12 user nova-compute[72954]: INFO nova.virt.block_device [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attempting to driver detach volume 4d38da95-d36d-4f5b-a450-2da4a2d1ac19 from mountpoint /dev/vdb
Sep 04 23:51:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Attempting to detach device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:51:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:51:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:51:12 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:51:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:51:12 user nova-compute[72954]:   <serial>4d38da95-d36d-4f5b-a450-2da4a2d1ac19</serial>
Sep 04 23:51:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:51:12 user nova-compute[72954]: </disk>
Sep 04 23:51:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:51:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config.
Sep 04 23:51:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:51:12 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:51:12 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:51:12 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:51:12 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:51:12 user nova-compute[72954]:   <serial>4d38da95-d36d-4f5b-a450-2da4a2d1ac19</serial>
Sep 04 23:51:12 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:51:12 user nova-compute[72954]: </disk>
Sep 04 23:51:12 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871473.3070695, 29c1b984-b059-4a9c-8137-59391b5990bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:51:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config.
Sep 04 23:51:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDMeYzmV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:51:13 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423df5b-4d26-4332-8d4d-58ef432fb572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed213e14-e00c-4d09-b776-b513d9cb4e76]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)
Sep 04 23:51:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 (non-flash)
Sep 04 23:51:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1302fe5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f302370-e91d-494b-9c94-245e6b8dd464]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a0670e-bf7b-427a-b8ac-33eb2dd92762]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2ac3fd-a86a-4922-b609-c73724f4b476]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe957a-0b2f-4e32-b518-837b9802014a]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ed200-2680-4c13-a66a-0618d807c2b8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56610b66-9051-42c4-965c-c5776b28d662]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260]
Sep 04 23:51:13 user nova-compute[72954]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19, portal: 172.16.0.220,3260] successful.
Sep 04 23:51:13 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d38da95-d36d-4f5b-a450-2da4a2d1ac19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[992963a2-d721-4cee-b5e2-be7199bd2b0a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== disconnect_volume: return (302ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:51:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:51:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:51:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-61be75ad-f380-45fd-a0e8-812170b54918 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:19 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:21 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:21 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8390MB free_disk=25.310253143310547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:51:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:23 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:51:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:51:31 user nova-compute[72954]: INFO nova.compute.claims [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Claim successful on node user
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:51:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.policy [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca716b5c013447f7a1742bbec8fb98bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedcd16ca304debb5faa75416c3aac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:51:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Creating image(s)
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "/opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "/opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Successfully created port: 203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk 1073741824" returned: 0 in 0.054s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:51:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Cannot resize image /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Ensure instance console log exists: /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Successfully updated port: 203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquired lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-changed-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Refreshing instance network info cache due to event network-changed-203cd448-c260-4de5-bc26-b04647445e2d. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] Acquiring lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:51:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Updating instance_info_cache with network_info: [{"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Releasing lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Instance network_info: |[{"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] Acquired lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Refreshing network info cache for port 203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Start _get_guest_xml network_info=[{"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:51:34 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:34 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1968308379',display_name='tempest-VolumesActionsTest-instance-1968308379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1968308379',id=36,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-jqbzizto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:51:32Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=fe6a5ef7-14b3-4055-8540-edd3a9f0227b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lazy-loading 'pci_devices' on Instance uuid fe6a5ef7-14b3-4055-8540-edd3a9f0227b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:51:34 user nova-compute[72954]:   <uuid>fe6a5ef7-14b3-4055-8540-edd3a9f0227b</uuid>
Sep 04 23:51:34 user nova-compute[72954]:   <name>instance-00000024</name>
Sep 04 23:51:34 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:51:34 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:51:34 user nova-compute[72954]:   <metadata>
Sep 04 23:51:34 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:51:34 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:name>tempest-VolumesActionsTest-instance-1968308379</nova:name>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:51:34</nova:creationTime>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:51:34 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:51:34 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:owner>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:user uuid="ca716b5c013447f7a1742bbec8fb98bd">tempest-VolumesActionsTest-2002974610-project-member</nova:user>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:project uuid="5bedcd16ca304debb5faa75416c3aac4">tempest-VolumesActionsTest-2002974610</nova:project>
Sep 04 23:51:34 user nova-compute[72954]:       </nova:owner>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:51:34 user nova-compute[72954]:       <nova:ports>
Sep 04 23:51:34 user nova-compute[72954]:         <nova:port uuid="203cd448-c260-4de5-bc26-b04647445e2d">
Sep 04 23:51:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Sep 04 23:51:34 user nova-compute[72954]:         </nova:port>
Sep 04 23:51:34 user nova-compute[72954]:       </nova:ports>
Sep 04 23:51:34 user nova-compute[72954]:     </nova:instance>
Sep 04 23:51:34 user nova-compute[72954]:   </metadata>
Sep 04 23:51:34 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:51:34 user nova-compute[72954]:     <system>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="serial">fe6a5ef7-14b3-4055-8540-edd3a9f0227b</entry>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="uuid">fe6a5ef7-14b3-4055-8540-edd3a9f0227b</entry>
Sep 04 23:51:34 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:51:34 user nova-compute[72954]:     </system>
Sep 04 23:51:34 user nova-compute[72954]:   </sysinfo>
Sep 04 23:51:34 user nova-compute[72954]:   <os>
Sep 04 23:51:34 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:51:34 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:51:34 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:51:34 user nova-compute[72954]:   </os>
Sep 04 23:51:34 user nova-compute[72954]:   <features>
Sep 04 23:51:34 user nova-compute[72954]:     <acpi/>
Sep 04 23:51:34 user nova-compute[72954]:     <apic/>
Sep 04 23:51:34 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:51:34 user nova-compute[72954]:   </features>
Sep 04 23:51:34 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:51:34 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:51:34 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:51:34 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:51:34 user nova-compute[72954]:   </clock>
Sep 04 23:51:34 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:51:34 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:51:34 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:51:34 user nova-compute[72954]:   </cpu>
Sep 04 23:51:34 user nova-compute[72954]:   <devices>
Sep 04 23:51:34 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:51:34 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:51:34 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk"/>
Sep 04 23:51:34 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:51:34 user nova-compute[72954]:     </disk>
Sep 04 23:51:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:51:34 user nova-compute[72954]:       <mac address="fa:16:3e:dc:1c:1a"/>
Sep 04 23:51:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:51:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:51:34 user nova-compute[72954]:       <target dev="tap203cd448-c2"/>
Sep 04 23:51:34 user nova-compute[72954]:     </interface>
Sep 04 23:51:34 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:51:34 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/console.log" append="off"/>
Sep 04 23:51:34 user nova-compute[72954]:     </serial>
Sep 04 23:51:34 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:51:34 user nova-compute[72954]:     <video>
Sep 04 23:51:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:51:34 user nova-compute[72954]:     </video>
Sep 04 23:51:34 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:51:34 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:51:34 user nova-compute[72954]:     </rng>
Sep 04 23:51:34 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:51:34 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:51:34 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:51:34 user nova-compute[72954]:     </memballoon>
Sep 04 23:51:34 user nova-compute[72954]:   </devices>
Sep 04 23:51:34 user nova-compute[72954]: </domain>
Sep 04 23:51:34 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1968308379',display_name='tempest-VolumesActionsTest-instance-1968308379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1968308379',id=36,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-jqbzizto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:51:32Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=fe6a5ef7-14b3-4055-8540-edd3a9f0227b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG os_vif [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203cd448-c2, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap203cd448-c2, col_values=(('external_ids', {'iface-id': '203cd448-c260-4de5-bc26-b04647445e2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:1c:1a', 'vm-uuid': 'fe6a5ef7-14b3-4055-8540-edd3a9f0227b'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:34 user nova-compute[72954]: INFO os_vif [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2')
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] No VIF found with MAC fa:16:3e:dc:1c:1a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Updated VIF entry in instance network info cache for port 203cd448-c260-4de5-bc26-b04647445e2d. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Updating instance_info_cache with network_info: [{"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:51:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ba726d3d-4cba-4ad2-b18c-d49533c8521a req-7d5f3473-6108-4702-a1aa-39c132c3908e service nova] Releasing lock "refresh_cache-fe6a5ef7-14b3-4055-8540-edd3a9f0227b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:51:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:51:36 user nova-compute[72954]: WARNING nova.compute.manager [req-10262005-1579-4600-8391-7f26bc5515a6 req-6e4ed403-74ce-4449-86fa-e70f50f3bb07 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state building and task_state spawning.
Sep 04 23:51:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871498.1879225, fe6a5ef7-14b3-4055-8540-edd3a9f0227b => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] VM Resumed (Lifecycle Event)
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Instance spawned successfully.
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871498.1926095, fe6a5ef7-14b3-4055-8540-edd3a9f0227b => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] VM Started (Lifecycle Event)
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:51:38 user nova-compute[72954]: WARNING nova.compute.manager [req-d003ead4-fc66-4604-b52a-60aec0201570 req-aba8d761-4efa-434b-acfa-a41b445a9d99 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state building and task_state spawning.
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Took 6.03 seconds to spawn the instance on the hypervisor.
Sep 04 23:51:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:38 user nova-compute[72954]: INFO nova.compute.manager [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Took 6.62 seconds to build instance.
Sep 04 23:51:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b41e3844-90cc-4c2e-af9e-e1dd122abb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.729s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:51:50 user nova-compute[72954]: INFO nova.compute.claims [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Claim successful on node user
Sep 04 23:51:50 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:51:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.policy [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22815594f2334a5aa727b3aab115af7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c910f268091a4c1090fb8adc3942c928', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:51:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Creating image(s)
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.217s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.232s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk 1073741824" returned: 0 in 0.069s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Successfully created port: 45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.247s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Cannot resize image /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Ensure instance console log exists: /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Successfully updated port: 45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing instance network info cache due to event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:51:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance network_info: |[{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start _get_guest_xml network_info=[{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:51:53 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:53 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X5P31RYgkOzXWDEt6QLUIOJ4DGcuYRvKiEQg4y4EE7cjNVVXbf71hKGMj5jxt+InDob53zAl+Oc7jwPyVikkSgrImtVXvxd6UnkgT+PCUopg/IupOaFjHSST0b80sKQ==',key_name='tempest-keypair-1637223520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_devices' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:51:53 user nova-compute[72954]:   <uuid>ff615b48-6435-4381-b124-39fb2da7ea88</uuid>
Sep 04 23:51:53 user nova-compute[72954]:   <name>instance-00000025</name>
Sep 04 23:51:53 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:51:53 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:51:53 user nova-compute[72954]:   <metadata>
Sep 04 23:51:53 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:51:53 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1568904586</nova:name>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:51:53</nova:creationTime>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:51:53 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:51:53 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:owner>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:user uuid="22815594f2334a5aa727b3aab115af7f">tempest-AttachVolumeShelveTestJSON-966339939-project-member</nova:user>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:project uuid="c910f268091a4c1090fb8adc3942c928">tempest-AttachVolumeShelveTestJSON-966339939</nova:project>
Sep 04 23:51:53 user nova-compute[72954]:       </nova:owner>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:51:53 user nova-compute[72954]:       <nova:ports>
Sep 04 23:51:53 user nova-compute[72954]:         <nova:port uuid="45cdba26-7e2e-403f-8528-633b4ba6754c">
Sep 04 23:51:53 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 04 23:51:53 user nova-compute[72954]:         </nova:port>
Sep 04 23:51:53 user nova-compute[72954]:       </nova:ports>
Sep 04 23:51:53 user nova-compute[72954]:     </nova:instance>
Sep 04 23:51:53 user nova-compute[72954]:   </metadata>
Sep 04 23:51:53 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:51:53 user nova-compute[72954]:     <system>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="serial">ff615b48-6435-4381-b124-39fb2da7ea88</entry>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="uuid">ff615b48-6435-4381-b124-39fb2da7ea88</entry>
Sep 04 23:51:53 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:51:53 user nova-compute[72954]:     </system>
Sep 04 23:51:53 user nova-compute[72954]:   </sysinfo>
Sep 04 23:51:53 user nova-compute[72954]:   <os>
Sep 04 23:51:53 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:51:53 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:51:53 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:51:53 user nova-compute[72954]:   </os>
Sep 04 23:51:53 user nova-compute[72954]:   <features>
Sep 04 23:51:53 user nova-compute[72954]:     <acpi/>
Sep 04 23:51:53 user nova-compute[72954]:     <apic/>
Sep 04 23:51:53 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:51:53 user nova-compute[72954]:   </features>
Sep 04 23:51:53 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:51:53 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:51:53 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:51:53 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:51:53 user nova-compute[72954]:   </clock>
Sep 04 23:51:53 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:51:53 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:51:53 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:51:53 user nova-compute[72954]:   </cpu>
Sep 04 23:51:53 user nova-compute[72954]:   <devices>
Sep 04 23:51:53 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:51:53 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:51:53 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk"/>
Sep 04 23:51:53 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:51:53 user nova-compute[72954]:     </disk>
Sep 04 23:51:53 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:51:53 user nova-compute[72954]:       <mac address="fa:16:3e:40:54:94"/>
Sep 04 23:51:53 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:51:53 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:51:53 user nova-compute[72954]:       <target dev="tap45cdba26-7e"/>
Sep 04 23:51:53 user nova-compute[72954]:     </interface>
Sep 04 23:51:53 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:51:53 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/console.log" append="off"/>
Sep 04 23:51:53 user nova-compute[72954]:     </serial>
Sep 04 23:51:53 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:51:53 user nova-compute[72954]:     <video>
Sep 04 23:51:53 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:51:53 user nova-compute[72954]:     </video>
Sep 04 23:51:53 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:51:53 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:51:53 user nova-compute[72954]:     </rng>
Sep 04 23:51:53 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:51:53 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:51:53 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:51:53 user nova-compute[72954]:     </memballoon>
Sep 04 23:51:53 user nova-compute[72954]:   </devices>
Sep 04 23:51:53 user nova-compute[72954]: </domain>
Sep 04 23:51:53 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X5P31RYgkOzXWDEt6QLUIOJ4DGcuYRvKiEQg4y4EE7cjNVVXbf71hKGMj5jxt+InDob53zAl+Oc7jwPyVikkSgrImtVXvxd6UnkgT+PCUopg/IupOaFjHSST0b80sKQ==',key_name='tempest-keypair-1637223520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG os_vif [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45cdba26-7e, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45cdba26-7e, col_values=(('external_ids', {'iface-id': '45cdba26-7e2e-403f-8528-633b4ba6754c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:54:94', 'vm-uuid': 'ff615b48-6435-4381-b124-39fb2da7ea88'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:53 user nova-compute[72954]: INFO os_vif [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e')
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:51:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No VIF found with MAC fa:16:3e:40:54:94, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:51:54 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updated VIF entry in instance network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:51:54 user nova-compute[72954]: DEBUG nova.network.neutron [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:51:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d4731cdd-0863-4246-9d2c-2ee8910a3eb9 req-b5e2ac84-e31f-4893-bace-5eed8b7934fe service nova] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:51:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:51:55 user nova-compute[72954]: WARNING nova.compute.manager [req-7e2cab89-8055-4dde-8841-d26d03f7b400 req-6810e63f-1963-449e-83c7-6669fa2487ce service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state building and task_state spawning.
Sep 04 23:51:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:51:57 user nova-compute[72954]: WARNING nova.compute.manager [req-b34514dc-8905-4b05-af81-61ce66bc4d15 req-7577999b-bcf6-4190-956d-596973f4171d service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state building and task_state spawning.
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871517.435537, ff615b48-6435-4381-b124-39fb2da7ea88 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Resumed (Lifecycle Event)
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance spawned successfully.
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871517.4381607, ff615b48-6435-4381-b124-39fb2da7ea88 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Started (Lifecycle Event)
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Took 6.32 seconds to spawn the instance on the hypervisor.
Sep 04 23:51:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:51:57 user nova-compute[72954]: INFO nova.compute.manager [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Took 7.08 seconds to build instance.
Sep 04 23:51:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aaba1c5f-22b2-4809-bdc7-09951ce7b204 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.222s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:51:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:01 user nova-compute[72954]: INFO nova.compute.manager [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Terminating instance
Sep 04 23:52:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-unplugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] No waiting events found dispatching network-vif-unplugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.compute.manager [req-88504a4a-c113-40b4-a790-cc866efa1ee7 req-c22b63a8-a24b-4a01-886d-3a6ec0745900 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-unplugged-3e19dddb-1a75-4349-8c64-5a8033a534ea for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:52:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Instance destroyed successfully.
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lazy-loading 'resources' on Instance uuid 45e0a0aa-766f-4c33-b91c-f1fb56019b3a {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:48:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1934944020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1934944',id=35,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS1QXdNOPPnahRI+l0+ehQNj/ZicERWZcM6CA5faYw5SnyvBbspVfUtlLRXNgaIsmm/2DWQwQ9YbNZ9JvJidM0Lrq+K9DXFC4LrM2UTM5S+LilzQBhp4T8sIUI8/bRjvw==',key_name='tempest-keypair-227029074',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4511811307c7443b966505de3e319a64',ramdisk_id='',reservation_id='r-6fy9fdov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2599232791bb463b8b2f725cb65431ad',uuid=45e0a0aa-766f-4c33-b91c-f1fb56019b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converting VIF {"id": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "address": "fa:16:3e:53:c2:5b", "network": {"id": "d5ef6ade-b783-4119-90fa-ea78613f92e1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597769128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4511811307c7443b966505de3e319a64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e19dddb-1a", "ovs_interfaceid": "3e19dddb-1a75-4349-8c64-5a8033a534ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG os_vif [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e19dddb-1a, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:52:02 user nova-compute[72954]: INFO os_vif [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:c2:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e19dddb-1a75-4349-8c64-5a8033a534ea,network=Network(d5ef6ade-b783-4119-90fa-ea78613f92e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e19dddb-1a')
Sep 04 23:52:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Deleting instance files /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a_del
Sep 04 23:52:02 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Deletion of /opt/stack/data/nova/instances/45e0a0aa-766f-4c33-b91c-f1fb56019b3a_del complete
Sep 04 23:52:02 user nova-compute[72954]: INFO nova.compute.manager [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Took 0.93 seconds to destroy the instance on the hypervisor.
Sep 04 23:52:02 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:52:02 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:52:03 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Took 0.78 seconds to deallocate network for instance.
Sep 04 23:52:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-46411479-05d7-478b-b0fe-3da430b90a36 req-e3b3663a-295a-4a57-9fb4-c2a28d2cb998 service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-deleted-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:52:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:03 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Deleted allocations for instance 45e0a0aa-766f-4c33-b91c-f1fb56019b3a
Sep 04 23:52:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cf4c95a-fa8b-4b65-af13-304289728ddc tempest-TestServerVolumeAttachScenarioOldVersion-2000130752 tempest-TestServerVolumeAttachScenarioOldVersion-2000130752-project-member] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] Acquiring lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] Lock "45e0a0aa-766f-4c33-b91c-f1fb56019b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] No waiting events found dispatching network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:52:04 user nova-compute[72954]: WARNING nova.compute.manager [req-622fbe7c-dc2c-4ee5-910c-928e70621308 req-3439f772-b018-4415-8c61-d7ffd13c9c7d service nova] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Received unexpected event network-vif-plugged-3e19dddb-1a75-4349-8c64-5a8033a534ea for instance with vm_state deleted and task_state None.
Sep 04 23:52:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:08 user nova-compute[72954]: INFO nova.compute.manager [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attaching volume 496c4834-1792-44a1-9f50-bcc239805053 to /dev/vdb
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.utils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2bbce7-8019-4114-a4ef-0261d0d95f28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f482aa7-77eb-4105-9bac-a93fa68ef1af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b2712-037f-4613-ab64-4da9fa8a19b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d735cf-fca3-4fd5-a842-0bec87ef17c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:52:08 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:52:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a2713-a087-4305-a6d3-fd0fa46f48b3]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG os_brick.utils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:52:08 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating existing volume attachment record: 8c0a2d2a-dda0-4ffe-9828-b28ead04e07c {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:52:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:17 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871522.6198864, 45e0a0aa-766f-4c33-b91c-f1fb56019b3a => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:52:17 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] VM Stopped (Lifecycle Event)
Sep 04 23:52:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f7f28790-c462-47fa-bc99-0b290b503e39 None None] [instance: 45e0a0aa-766f-4c33-b91c-f1fb56019b3a] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:52:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:19 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:20 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:22 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:52:22 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8224MB free_disk=25.269916534423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance fe6a5ef7-14b3-4055-8540-edd3a9f0227b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ff615b48-6435-4381-b124-39fb2da7ea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OieTmjUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:52:23 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:52:23 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:52:23 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4a313e-4872-49ea-a013-1bb6936cf867]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:52:23 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f33bf3-e2cc-49f3-809d-a22c0f9bd11f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:23 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053] added
Sep 04 23:52:23 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8235ac0b-09a6-41f9-8225-a50aa7152bf3]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94857a1-fbbd-4808-9b84-794a6497f82f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OieTmjUN {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OieTmjUN" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2ab4c-34d0-46fa-9e38-1b6a37a86af2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OieTmjUN'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118568c-adf5-41d9-9b23-ac856ebd263f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edff4d1-8287-4466-906b-53a1e14511db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:52:24 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:52:24 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:52:24 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:52:24 user nova-compute[72954]: 
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6704528-934c-42a3-9706-c8800b471704]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260]
Sep 04 23:52:24 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260] successful.
Sep 04 23:52:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d8328-ec14-46e3-b8e3-79b88473db29]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cda8f0d-8bce-46cd-87b7-454d1035a417]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)
Sep 04 23:52:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)
Sep 04 23:52:24 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79ac88-6957-4105-967c-2a1c5bec2adb]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:24 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OieTmjUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23430396634343535', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430396634343535', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.objects.instance [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:52:25 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:52:25 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:52:25 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:52:25 user nova-compute[72954]:   <serial>496c4834-1792-44a1-9f50-bcc239805053</serial>
Sep 04 23:52:25 user nova-compute[72954]: </disk>
Sep 04 23:52:25 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] No VIF found with MAC fa:16:3e:4c:76:3a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-9daeaef3-ff29-4aea-a049-3a58abd2478a tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.461s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:28 user nova-compute[72954]: INFO nova.compute.manager [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Detaching volume 496c4834-1792-44a1-9f50-bcc239805053
Sep 04 23:52:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Attempting to driver detach volume 496c4834-1792-44a1-9f50-bcc239805053 from mountpoint /dev/vdb
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Attempting to detach device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:52:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:52:28 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:52:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:52:28 user nova-compute[72954]:   <serial>496c4834-1792-44a1-9f50-bcc239805053</serial>
Sep 04 23:52:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:52:28 user nova-compute[72954]: </disk>
Sep 04 23:52:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:52:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the persistent domain config.
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:52:28 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:52:28 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:52:28 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:52:28 user nova-compute[72954]:   <serial>496c4834-1792-44a1-9f50-bcc239805053</serial>
Sep 04 23:52:28 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:52:28 user nova-compute[72954]: </disk>
Sep 04 23:52:28 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871548.9509566, 29c1b984-b059-4a9c-8137-59391b5990bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:52:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully detached device vdb from instance 29c1b984-b059-4a9c-8137-59391b5990bf from the live domain config.
Sep 04 23:52:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OieTmjUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:52:28 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:52:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f52d5b-740b-4b61-bdd6-7797047898b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfe746-7b3a-49ea-b6c4-3beacab58f68]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)
Sep 04 23:52:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 (non-flash)
Sep 04 23:52:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd130105120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9829d2e6-1f87-4dce-8bd0-29c601d6262c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0431d8fc-b9ea-4950-a0d2-7c1dbbc1a151]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[462e93b2-7b33-4c22-b377-898285227200]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26325a9f-65a2-4d5e-af28-73db00d77d93]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b34c43-ae00-4dd5-a33b-083be791cd74]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e8f61-bd47-4ff5-a652-282448d752a4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260]
Sep 04 23:52:29 user nova-compute[72954]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053, portal: 172.16.0.220,3260] successful.
Sep 04 23:52:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496c4834-1792-44a1-9f50-bcc239805053 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99373a56-8e98-4871-a7b8-a20eff022456]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] <== disconnect_volume: return (288ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:52:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:52:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:52:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:52:33 user nova-compute[72954]: DEBUG nova.objects.instance [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'flavor' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:52:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97d3e756-d4e6-4c7f-834f-2900964fc517 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.730s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:52:37 user nova-compute[72954]: INFO nova.compute.claims [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Claim successful on node user
Sep 04 23:52:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:52:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:52:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.policy [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e74525debeb4cc6b7ef76391a758324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c295760b33f94d48b94ec62442784e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:52:38 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Creating image(s)
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "/opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "/opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "/opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.216s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk 1073741824" returned: 0 in 0.054s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Successfully created port: 08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:52:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Cannot resize image /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Ensure instance console log exists: /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Successfully updated port: 08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquired lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-changed-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Refreshing instance network info cache due to event network-changed-08b10aba-9043-47f2-b117-72911e2eedc1. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] Acquiring lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Releasing lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Instance network_info: |[{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] Acquired lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Refreshing network info cache for port 08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:52:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Start _get_guest_xml network_info=[{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:52:40 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:52:40 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1999200719',display_name='tempest-TestServerVolumeAttachmentScenario-server-1999200719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1999200719',id=38,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmeWsPU+g9/XOXxnYl3FlWMloMqgJCz+NDszFcnHcXBf6nE97g3h9qzTXLZgIrN3hapFkafB8C7DJ3aqVjMWUYP7iflv7xr2fhBL1QqZXPxZOuXfImJAQ2cMgbi2CWr5w==',key_name='tempest-keypair-569245018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c295760b33f94d48b94ec62442784e0f',ramdisk_id='',reservation_id='r-cmtftert',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-575760748',owner_user_name='tempest-TestServerVolumeAttachmentScenario-575760748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e74525debeb4cc6b7ef76391a758324',uuid=de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converting VIF {"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'pci_devices' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:52:40 user nova-compute[72954]:   <uuid>de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1</uuid>
Sep 04 23:52:40 user nova-compute[72954]:   <name>instance-00000026</name>
Sep 04 23:52:40 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:52:40 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:52:40 user nova-compute[72954]:   <metadata>
Sep 04 23:52:40 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:52:40 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1999200719</nova:name>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:52:40</nova:creationTime>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:52:40 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:52:40 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:owner>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:user uuid="1e74525debeb4cc6b7ef76391a758324">tempest-TestServerVolumeAttachmentScenario-575760748-project-member</nova:user>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:project uuid="c295760b33f94d48b94ec62442784e0f">tempest-TestServerVolumeAttachmentScenario-575760748</nova:project>
Sep 04 23:52:40 user nova-compute[72954]:       </nova:owner>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:52:40 user nova-compute[72954]:       <nova:ports>
Sep 04 23:52:40 user nova-compute[72954]:         <nova:port uuid="08b10aba-9043-47f2-b117-72911e2eedc1">
Sep 04 23:52:40 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:52:40 user nova-compute[72954]:         </nova:port>
Sep 04 23:52:40 user nova-compute[72954]:       </nova:ports>
Sep 04 23:52:40 user nova-compute[72954]:     </nova:instance>
Sep 04 23:52:40 user nova-compute[72954]:   </metadata>
Sep 04 23:52:40 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:52:40 user nova-compute[72954]:     <system>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="serial">de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1</entry>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="uuid">de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1</entry>
Sep 04 23:52:40 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:52:40 user nova-compute[72954]:     </system>
Sep 04 23:52:40 user nova-compute[72954]:   </sysinfo>
Sep 04 23:52:40 user nova-compute[72954]:   <os>
Sep 04 23:52:40 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:52:40 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:52:40 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:52:40 user nova-compute[72954]:   </os>
Sep 04 23:52:40 user nova-compute[72954]:   <features>
Sep 04 23:52:40 user nova-compute[72954]:     <acpi/>
Sep 04 23:52:40 user nova-compute[72954]:     <apic/>
Sep 04 23:52:40 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:52:40 user nova-compute[72954]:   </features>
Sep 04 23:52:40 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:52:40 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:52:40 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:52:40 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:52:40 user nova-compute[72954]:   </clock>
Sep 04 23:52:40 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:52:40 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:52:40 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:52:40 user nova-compute[72954]:   </cpu>
Sep 04 23:52:40 user nova-compute[72954]:   <devices>
Sep 04 23:52:40 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:52:40 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:52:40 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk"/>
Sep 04 23:52:40 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:52:40 user nova-compute[72954]:     </disk>
Sep 04 23:52:40 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:52:40 user nova-compute[72954]:       <mac address="fa:16:3e:23:d8:e9"/>
Sep 04 23:52:40 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:52:40 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:52:40 user nova-compute[72954]:       <target dev="tap08b10aba-90"/>
Sep 04 23:52:40 user nova-compute[72954]:     </interface>
Sep 04 23:52:40 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:52:40 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/console.log" append="off"/>
Sep 04 23:52:40 user nova-compute[72954]:     </serial>
Sep 04 23:52:40 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:52:40 user nova-compute[72954]:     <video>
Sep 04 23:52:40 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:52:40 user nova-compute[72954]:     </video>
Sep 04 23:52:40 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:52:40 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:52:40 user nova-compute[72954]:     </rng>
Sep 04 23:52:40 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:52:40 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:52:40 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:52:40 user nova-compute[72954]:     </memballoon>
Sep 04 23:52:40 user nova-compute[72954]:   </devices>
Sep 04 23:52:40 user nova-compute[72954]: </domain>
Sep 04 23:52:40 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1999200719',display_name='tempest-TestServerVolumeAttachmentScenario-server-1999200719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1999200719',id=38,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmeWsPU+g9/XOXxnYl3FlWMloMqgJCz+NDszFcnHcXBf6nE97g3h9qzTXLZgIrN3hapFkafB8C7DJ3aqVjMWUYP7iflv7xr2fhBL1QqZXPxZOuXfImJAQ2cMgbi2CWr5w==',key_name='tempest-keypair-569245018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c295760b33f94d48b94ec62442784e0f',ramdisk_id='',reservation_id='r-cmtftert',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-575760748',owner_user_name='tempest-TestServerVolumeAttachmentScenario-575760748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e74525debeb4cc6b7ef76391a758324',uuid=de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converting VIF {"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG os_vif [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08b10aba-90, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08b10aba-90, col_values=(('external_ids', {'iface-id': '08b10aba-9043-47f2-b117-72911e2eedc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:d8:e9', 'vm-uuid': 'de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:40 user nova-compute[72954]: INFO os_vif [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90')
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No VIF found with MAC fa:16:3e:23:d8:e9, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updated VIF entry in instance network info cache for port 08b10aba-9043-47f2-b117-72911e2eedc1. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG nova.network.neutron [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:52:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4a02c29f-6459-42b0-9c8a-4de8cb44480a req-7a8bc7c9-226a-464a-a1cd-5d0e77539c43 service nova] Releasing lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] No waiting events found dispatching network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:52:41 user nova-compute[72954]: WARNING nova.compute.manager [req-c0a646b6-697c-4e46-a2f9-f279bf206edd req-54212772-d5d2-4056-b791-99bd3228d20e service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received unexpected event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 for instance with vm_state building and task_state spawning.
Sep 04 23:52:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871563.7320185, de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] VM Resumed (Lifecycle Event)
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Instance spawned successfully.
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871563.734009, de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] VM Started (Lifecycle Event)
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Took 5.72 seconds to spawn the instance on the hypervisor.
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] No waiting events found dispatching network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:52:43 user nova-compute[72954]: WARNING nova.compute.manager [req-c5300d06-9a0d-49bc-a4f4-b6dca4cbed3b req-5912be40-111c-458b-8599-27363ff08139 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received unexpected event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 for instance with vm_state building and task_state spawning.
Sep 04 23:52:43 user nova-compute[72954]: INFO nova.compute.manager [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Took 6.39 seconds to build instance.
Sep 04 23:52:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-f27a9900-d25b-4639-aff3-942bb859e4ab tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.505s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:52:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:52:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:53:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:21 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:22 user nova-compute[72954]: INFO nova.compute.manager [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Terminating instance
Sep 04 23:53:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-e9a205a6-08a0-49c2-99e9-85c677b1fc6f req-7fe1d247-54ac-4edd-8652-12c2209da5d9 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Instance destroyed successfully.
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.objects.instance [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lazy-loading 'resources' on Instance uuid fe6a5ef7-14b3-4055-8540-edd3a9f0227b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1968308379',display_name='tempest-VolumesActionsTest-instance-1968308379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1968308379',id=36,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:51:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-jqbzizto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:51:38Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=fe6a5ef7-14b3-4055-8540-edd3a9f0227b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "203cd448-c260-4de5-bc26-b04647445e2d", "address": "fa:16:3e:dc:1c:1a", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap203cd448-c2", "ovs_interfaceid": "203cd448-c260-4de5-bc26-b04647445e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG os_vif [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203cd448-c2, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:53:23 user nova-compute[72954]: INFO os_vif [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:1c:1a,bridge_name='br-int',has_traffic_filtering=True,id=203cd448-c260-4de5-bc26-b04647445e2d,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203cd448-c2')
Sep 04 23:53:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Deleting instance files /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b_del
Sep 04 23:53:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Deletion of /opt/stack/data/nova/instances/fe6a5ef7-14b3-4055-8540-edd3a9f0227b_del complete
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:23 user nova-compute[72954]: INFO nova.compute.manager [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Took 0.81 seconds to destroy the instance on the hypervisor.
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=25.21078872680664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 29c1b984-b059-4a9c-8137-59391b5990bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance fe6a5ef7-14b3-4055-8540-edd3a9f0227b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ff615b48-6435-4381-b124-39fb2da7ea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:53:24 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Took 0.97 seconds to deallocate network for instance.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.126s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Deleted allocations for instance fe6a5ef7-14b3-4055-8540-edd3a9f0227b
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-97dd9949-394b-4730-ade9-1c07f12bbb9b tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state deleted and task_state None.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state deleted and task_state None.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state deleted and task_state None.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-unplugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state deleted and task_state None.
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-deleted-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Acquiring lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] Lock "fe6a5ef7-14b3-4055-8540-edd3a9f0227b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] No waiting events found dispatching network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:24 user nova-compute[72954]: WARNING nova.compute.manager [req-bbef0bb5-7882-468b-a554-ef425c18a369 req-dc6dc2d9-d10e-4a72-ac3c-e2e6005b0117 service nova] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Received unexpected event network-vif-plugged-203cd448-c260-4de5-bc26-b04647445e2d for instance with vm_state deleted and task_state None.
Sep 04 23:53:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:53:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:53:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:53:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [{"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:53:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-29c1b984-b059-4a9c-8137-59391b5990bf" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:53:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871603.253263, fe6a5ef7-14b3-4055-8540-edd3a9f0227b => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:53:38 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] VM Stopped (Lifecycle Event)
Sep 04 23:53:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9f3065a0-7d82-4afa-96ef-edb16aeaf7f4 None None] [instance: fe6a5ef7-14b3-4055-8540-edd3a9f0227b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:53:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing instance network info cache due to event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:53:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:53:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updated VIF entry in instance network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:53:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:53:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bf8c0e1a-ce4d-44f0-96e8-24d60157ea50 req-2d308a53-31e1-4722-84a0-4ff230d4fa93 service nova] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:53:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:47 user nova-compute[72954]: INFO nova.compute.manager [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Shelving
Sep 04 23:53:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance destroyed successfully.
Sep 04 23:53:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Beginning cold snapshot process
Sep 04 23:53:48 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:53:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk /opt/stack/data/nova/instances/snapshots/tmpsmqjq6mv/c33e8fea5ad94d519b2f596faa89c4ba {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk /opt/stack/data/nova/instances/snapshots/tmpsmqjq6mv/c33e8fea5ad94d519b2f596faa89c4ba" returned: 0 in 0.711s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Snapshot extracted, beginning image upload
Sep 04 23:53:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Snapshot image upload complete
Sep 04 23:53:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:53:52 user nova-compute[72954]: INFO nova.compute.manager [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Shelve offloading
Sep 04 23:53:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance destroyed successfully.
Sep 04 23:53:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:53:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:53 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:53 user nova-compute[72954]: WARNING nova.compute.manager [req-2bb1e4c6-8c65-4b02-aaff-10a7593b7b0a req-01611e41-6f9f-42be-95d9-01a5899ff855 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state shelved and task_state shelving_offloading.
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:53:54 user nova-compute[72954]: WARNING nova.compute.manager [req-46128041-fd54-4b0f-9fc3-43b61d200de0 req-cf021823-037e-41e5-ac2e-e851da81fc25 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state shelved and task_state shelving_offloading.
Sep 04 23:53:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance destroyed successfully.
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'resources' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X5P31RYgkOzXWDEt6QLUIOJ4DGcuYRvKiEQg4y4EE7cjNVVXbf71hKGMj5jxt+InDob53zAl+Oc7jwPyVikkSgrImtVXvxd6UnkgT+PCUopg/IupOaFjHSST0b80sKQ==',key_name='tempest-keypair-1637223520',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:53:52.246188',shelved_host='user',shelved_image_id='4e781784-ec9c-44fc-b53a-a4c73d122965'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG os_vif [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45cdba26-7e, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:53:54 user nova-compute[72954]: INFO os_vif [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e')
Sep 04 23:53:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Deleting instance files /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88_del
Sep 04 23:53:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Deletion of /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88_del complete
Sep 04 23:53:54 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Deleted allocations for instance ff615b48-6435-4381-b124-39fb2da7ea88
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'numa_topology' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.objects.base [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ff615b48-6435-4381-b124-39fb2da7ea88> lazy-loaded attributes: resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-65a90238-a364-4b82-9df8-d982c5d62fb4 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.080s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:53:58 user nova-compute[72954]: INFO nova.compute.claims [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Claim successful on node user
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:53:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.policy [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6a96b3e1f6f4599a8bb0920b6f7b2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4048c7fcec74d06aab1b693bed32639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:53:58 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Creating image(s)
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "/opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "/opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "/opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:58 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk 1073741824" returned: 0 in 0.052s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Successfully created port: f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Cannot resize image /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Ensure instance console log exists: /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Successfully updated port: f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing instance network info cache due to event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:53:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Instance network_info: |[{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Start _get_guest_xml network_info=[{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:54:00 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:00 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1145103175',display_name='tempest-TestStampPattern-server-1145103175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1145103175',id=39,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-r3rdk9bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:53:58Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=b814f212-ae45-49c1-8101-2d86f3c970e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.objects.instance [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'pci_devices' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:54:00 user nova-compute[72954]:   <uuid>b814f212-ae45-49c1-8101-2d86f3c970e0</uuid>
Sep 04 23:54:00 user nova-compute[72954]:   <name>instance-00000027</name>
Sep 04 23:54:00 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:54:00 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:54:00 user nova-compute[72954]:   <metadata>
Sep 04 23:54:00 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:54:00 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:name>tempest-TestStampPattern-server-1145103175</nova:name>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:54:00</nova:creationTime>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:54:00 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:54:00 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:owner>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:user uuid="a6a96b3e1f6f4599a8bb0920b6f7b2d4">tempest-TestStampPattern-1760060686-project-member</nova:user>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:project uuid="f4048c7fcec74d06aab1b693bed32639">tempest-TestStampPattern-1760060686</nova:project>
Sep 04 23:54:00 user nova-compute[72954]:       </nova:owner>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:54:00 user nova-compute[72954]:       <nova:ports>
Sep 04 23:54:00 user nova-compute[72954]:         <nova:port uuid="f0d8897e-be82-457e-b44c-3c477bd9e809">
Sep 04 23:54:00 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Sep 04 23:54:00 user nova-compute[72954]:         </nova:port>
Sep 04 23:54:00 user nova-compute[72954]:       </nova:ports>
Sep 04 23:54:00 user nova-compute[72954]:     </nova:instance>
Sep 04 23:54:00 user nova-compute[72954]:   </metadata>
Sep 04 23:54:00 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:54:00 user nova-compute[72954]:     <system>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="serial">b814f212-ae45-49c1-8101-2d86f3c970e0</entry>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="uuid">b814f212-ae45-49c1-8101-2d86f3c970e0</entry>
Sep 04 23:54:00 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:54:00 user nova-compute[72954]:     </system>
Sep 04 23:54:00 user nova-compute[72954]:   </sysinfo>
Sep 04 23:54:00 user nova-compute[72954]:   <os>
Sep 04 23:54:00 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:54:00 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:54:00 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:54:00 user nova-compute[72954]:   </os>
Sep 04 23:54:00 user nova-compute[72954]:   <features>
Sep 04 23:54:00 user nova-compute[72954]:     <acpi/>
Sep 04 23:54:00 user nova-compute[72954]:     <apic/>
Sep 04 23:54:00 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:54:00 user nova-compute[72954]:   </features>
Sep 04 23:54:00 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:54:00 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:54:00 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:54:00 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:54:00 user nova-compute[72954]:   </clock>
Sep 04 23:54:00 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:54:00 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:54:00 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:54:00 user nova-compute[72954]:   </cpu>
Sep 04 23:54:00 user nova-compute[72954]:   <devices>
Sep 04 23:54:00 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:54:00 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:54:00 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk"/>
Sep 04 23:54:00 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:54:00 user nova-compute[72954]:     </disk>
Sep 04 23:54:00 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:54:00 user nova-compute[72954]:       <mac address="fa:16:3e:b9:e1:bf"/>
Sep 04 23:54:00 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:54:00 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:54:00 user nova-compute[72954]:       <target dev="tapf0d8897e-be"/>
Sep 04 23:54:00 user nova-compute[72954]:     </interface>
Sep 04 23:54:00 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:54:00 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/console.log" append="off"/>
Sep 04 23:54:00 user nova-compute[72954]:     </serial>
Sep 04 23:54:00 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:54:00 user nova-compute[72954]:     <video>
Sep 04 23:54:00 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:54:00 user nova-compute[72954]:     </video>
Sep 04 23:54:00 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:54:00 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:54:00 user nova-compute[72954]:     </rng>
Sep 04 23:54:00 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:54:00 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:54:00 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:54:00 user nova-compute[72954]:     </memballoon>
Sep 04 23:54:00 user nova-compute[72954]:   </devices>
Sep 04 23:54:00 user nova-compute[72954]: </domain>
Sep 04 23:54:00 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1145103175',display_name='tempest-TestStampPattern-server-1145103175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1145103175',id=39,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-r3rdk9bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:53:58Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=b814f212-ae45-49c1-8101-2d86f3c970e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG os_vif [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0d8897e-be, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0d8897e-be, col_values=(('external_ids', {'iface-id': 'f0d8897e-be82-457e-b44c-3c477bd9e809', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:e1:bf', 'vm-uuid': 'b814f212-ae45-49c1-8101-2d86f3c970e0'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:00 user nova-compute[72954]: INFO os_vif [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be')
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No VIF found with MAC fa:16:3e:b9:e1:bf, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated VIF entry in instance network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG nova.network.neutron [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f4a59224-d0b7-4228-b3c1-a30473468f96 req-fc221c0a-4094-46f2-b3cb-e1f1b9f92d15 service nova] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:01 user nova-compute[72954]: DEBUG nova.compute.manager [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] No waiting events found dispatching network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:01 user nova-compute[72954]: WARNING nova.compute.manager [req-0fb80d65-bdd2-4d30-a0c7-030414fd5bd0 req-450f6f85-6aef-478c-ab8d-101752db7d76 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received unexpected event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 for instance with vm_state building and task_state spawning.
Sep 04 23:54:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871628.2998369, ff615b48-6435-4381-b124-39fb2da7ea88 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Stopped (Lifecycle Event)
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c69b82fe-db08-4019-8643-65465f4316fe None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871643.7558513, b814f212-ae45-49c1-8101-2d86f3c970e0 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] VM Resumed (Lifecycle Event)
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Instance spawned successfully.
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871643.7574944, b814f212-ae45-49c1-8101-2d86f3c970e0 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] VM Started (Lifecycle Event)
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Took 5.30 seconds to spawn the instance on the hypervisor.
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:03 user nova-compute[72954]: DEBUG nova.compute.manager [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] No waiting events found dispatching network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:03 user nova-compute[72954]: WARNING nova.compute.manager [req-381fe160-c056-466a-bb25-5e61d67336ad req-3ef8ab9e-621e-4c58-adf3-2fa4ca83d3e8 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received unexpected event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 for instance with vm_state building and task_state spawning.
Sep 04 23:54:03 user nova-compute[72954]: INFO nova.compute.manager [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Took 5.89 seconds to build instance.
Sep 04 23:54:03 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e545b51c-bb29-4619-9538-0b551fbb31b6 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:54:14 user nova-compute[72954]: INFO nova.compute.claims [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Claim successful on node user
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:54:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:54:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Creating image(s)
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "/opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "/opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG nova.policy [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca716b5c013447f7a1742bbec8fb98bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedcd16ca304debb5faa75416c3aac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:54:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk 1073741824" returned: 0 in 0.063s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Successfully created port: 03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Cannot resize image /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Ensure instance console log exists: /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Successfully updated port: 03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquired lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-changed-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.compute.manager [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Refreshing instance network info cache due to event network-changed-03872f3b-7b14-4d18-8bca-bc5a04b624db. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] Acquiring lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Updating instance_info_cache with network_info: [{"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Releasing lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Instance network_info: |[{"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] Acquired lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.neutron [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Refreshing network info cache for port 03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Start _get_guest_xml network_info=[{"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:54:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:16 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351127936',display_name='tempest-VolumesActionsTest-instance-1351127936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351127936',id=40,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-pdu2pnem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:54:15Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=d4cd0f5d-19ba-4977-89c9-59b2e5876672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.objects.instance [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lazy-loading 'pci_devices' on Instance uuid d4cd0f5d-19ba-4977-89c9-59b2e5876672 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:54:16 user nova-compute[72954]:   <uuid>d4cd0f5d-19ba-4977-89c9-59b2e5876672</uuid>
Sep 04 23:54:16 user nova-compute[72954]:   <name>instance-00000028</name>
Sep 04 23:54:16 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:54:16 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:54:16 user nova-compute[72954]:   <metadata>
Sep 04 23:54:16 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:54:16 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:name>tempest-VolumesActionsTest-instance-1351127936</nova:name>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:54:16</nova:creationTime>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:54:16 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:54:16 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:owner>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:user uuid="ca716b5c013447f7a1742bbec8fb98bd">tempest-VolumesActionsTest-2002974610-project-member</nova:user>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:project uuid="5bedcd16ca304debb5faa75416c3aac4">tempest-VolumesActionsTest-2002974610</nova:project>
Sep 04 23:54:16 user nova-compute[72954]:       </nova:owner>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:54:16 user nova-compute[72954]:       <nova:ports>
Sep 04 23:54:16 user nova-compute[72954]:         <nova:port uuid="03872f3b-7b14-4d18-8bca-bc5a04b624db">
Sep 04 23:54:16 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 04 23:54:16 user nova-compute[72954]:         </nova:port>
Sep 04 23:54:16 user nova-compute[72954]:       </nova:ports>
Sep 04 23:54:16 user nova-compute[72954]:     </nova:instance>
Sep 04 23:54:16 user nova-compute[72954]:   </metadata>
Sep 04 23:54:16 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:54:16 user nova-compute[72954]:     <system>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="serial">d4cd0f5d-19ba-4977-89c9-59b2e5876672</entry>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="uuid">d4cd0f5d-19ba-4977-89c9-59b2e5876672</entry>
Sep 04 23:54:16 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:54:16 user nova-compute[72954]:     </system>
Sep 04 23:54:16 user nova-compute[72954]:   </sysinfo>
Sep 04 23:54:16 user nova-compute[72954]:   <os>
Sep 04 23:54:16 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:54:16 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:54:16 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:54:16 user nova-compute[72954]:   </os>
Sep 04 23:54:16 user nova-compute[72954]:   <features>
Sep 04 23:54:16 user nova-compute[72954]:     <acpi/>
Sep 04 23:54:16 user nova-compute[72954]:     <apic/>
Sep 04 23:54:16 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:54:16 user nova-compute[72954]:   </features>
Sep 04 23:54:16 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:54:16 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:54:16 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:54:16 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:54:16 user nova-compute[72954]:   </clock>
Sep 04 23:54:16 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:54:16 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:54:16 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:54:16 user nova-compute[72954]:   </cpu>
Sep 04 23:54:16 user nova-compute[72954]:   <devices>
Sep 04 23:54:16 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:54:16 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:54:16 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk"/>
Sep 04 23:54:16 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:54:16 user nova-compute[72954]:     </disk>
Sep 04 23:54:16 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:54:16 user nova-compute[72954]:       <mac address="fa:16:3e:c7:a7:59"/>
Sep 04 23:54:16 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:54:16 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:54:16 user nova-compute[72954]:       <target dev="tap03872f3b-7b"/>
Sep 04 23:54:16 user nova-compute[72954]:     </interface>
Sep 04 23:54:16 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:54:16 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/console.log" append="off"/>
Sep 04 23:54:16 user nova-compute[72954]:     </serial>
Sep 04 23:54:16 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:54:16 user nova-compute[72954]:     <video>
Sep 04 23:54:16 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:54:16 user nova-compute[72954]:     </video>
Sep 04 23:54:16 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:54:16 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:54:16 user nova-compute[72954]:     </rng>
Sep 04 23:54:16 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:54:16 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:54:16 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:54:16 user nova-compute[72954]:     </memballoon>
Sep 04 23:54:16 user nova-compute[72954]:   </devices>
Sep 04 23:54:16 user nova-compute[72954]: </domain>
Sep 04 23:54:16 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351127936',display_name='tempest-VolumesActionsTest-instance-1351127936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351127936',id=40,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-pdu2pnem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:54:15Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=d4cd0f5d-19ba-4977-89c9-59b2e5876672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG os_vif [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03872f3b-7b, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03872f3b-7b, col_values=(('external_ids', {'iface-id': '03872f3b-7b14-4d18-8bca-bc5a04b624db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:a7:59', 'vm-uuid': 'd4cd0f5d-19ba-4977-89c9-59b2e5876672'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:54:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:16 user nova-compute[72954]: INFO os_vif [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b')
Sep 04 23:54:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:54:17 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] No VIF found with MAC fa:16:3e:c7:a7:59, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:54:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Updated VIF entry in instance network info cache for port 03872f3b-7b14-4d18-8bca-bc5a04b624db. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:54:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Updating instance_info_cache with network_info: [{"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4f19761b-b7a1-4c7a-aa80-dd77741e1009 req-6e63867f-129d-4fed-a6fe-9adb1d64feb7 service nova] Releasing lock "refresh_cache-d4cd0f5d-19ba-4977-89c9-59b2e5876672" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] No waiting events found dispatching network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:18 user nova-compute[72954]: WARNING nova.compute.manager [req-91cccf06-2093-4aed-84ae-3ce41cf559f4 req-b1eee19d-d2dd-4f6e-aa67-b8a286f238fb service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received unexpected event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db for instance with vm_state building and task_state spawning.
Sep 04 23:54:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871660.3874235, d4cd0f5d-19ba-4977-89c9-59b2e5876672 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] VM Resumed (Lifecycle Event)
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Instance spawned successfully.
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871660.3889384, d4cd0f5d-19ba-4977-89c9-59b2e5876672 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] VM Started (Lifecycle Event)
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Took 5.54 seconds to spawn the instance on the hypervisor.
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:20 user nova-compute[72954]: INFO nova.compute.manager [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Took 6.30 seconds to build instance.
Sep 04 23:54:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-36af9f1e-ee67-4e89-b97c-76651c6586da tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.397s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] No waiting events found dispatching network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:20 user nova-compute[72954]: WARNING nova.compute.manager [req-7cc17201-39de-49c5-b7fc-b0e7f96e7d9b req-8c237898-4842-4e5f-9540-7c1ea537608a service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received unexpected event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db for instance with vm_state active and task_state None.
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:21 user nova-compute[72954]: INFO nova.compute.manager [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Terminating instance
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-unplugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] No waiting events found dispatching network-vif-unplugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.compute.manager [req-4692cc17-5628-4e17-ab48-6d9fab5603d3 req-81f7412a-a649-4a05-a76f-28bd01a478f3 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-unplugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Instance destroyed successfully.
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.objects.instance [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lazy-loading 'resources' on Instance uuid 29c1b984-b059-4a9c-8137-59391b5990bf {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1297423734',display_name='tempest-SnapshotDataIntegrityTests-server-1297423734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1297423734',id=32,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHihYcPIcSoAF9jj7TEAYOykpxzxiE2z+J2mcQELAYHwzAnqT4B9FX5eFWDGxRQxvRSN4LClJgZaeBD6IITujkl7lTwEvyWdAa6vJkMUb7b1xVtYeuxBAERnYXhSnoT54A==',key_name='tempest-keypair-110536965',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b393bd669d743a681aafa6875303a01',ramdisk_id='',reservation_id='r-l5acardi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-225866483',owner_user_name='tempest-SnapshotDataIntegrityTests-225866483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='536a0b82fb19498e8429269cc4857915',uuid=29c1b984-b059-4a9c-8137-59391b5990bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converting VIF {"id": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "address": "fa:16:3e:4c:76:3a", "network": {"id": "570c1897-b365-4743-83cf-ed9481935dca", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1665571973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b393bd669d743a681aafa6875303a01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623f4a68-c8", "ovs_interfaceid": "623f4a68-c81d-4e52-87ea-4593ab6b3074", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG os_vif [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap623f4a68-c8, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:54:21 user nova-compute[72954]: INFO os_vif [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=623f4a68-c81d-4e52-87ea-4593ab6b3074,network=Network(570c1897-b365-4743-83cf-ed9481935dca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623f4a68-c8')
Sep 04 23:54:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Deleting instance files /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf_del
Sep 04 23:54:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Deletion of /opt/stack/data/nova/instances/29c1b984-b059-4a9c-8137-59391b5990bf_del complete
Sep 04 23:54:21 user nova-compute[72954]: INFO nova.compute.manager [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Took 0.95 seconds to destroy the instance on the hypervisor.
Sep 04 23:54:21 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:54:21 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0383e20-03da-4484-972a-b825a9733794 req-2d155949-2d97-4c52-a758-6fec2fc16332 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-deleted-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:22 user nova-compute[72954]: INFO nova.compute.manager [req-c0383e20-03da-4484-972a-b825a9733794 req-2d155949-2d97-4c52-a758-6fec2fc16332 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Neutron deleted interface 623f4a68-c81d-4e52-87ea-4593ab6b3074; detaching it from the instance and deleting it from the info cache
Sep 04 23:54:22 user nova-compute[72954]: DEBUG nova.network.neutron [req-c0383e20-03da-4484-972a-b825a9733794 req-2d155949-2d97-4c52-a758-6fec2fc16332 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:22 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Took 0.89 seconds to deallocate network for instance.
Sep 04 23:54:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0383e20-03da-4484-972a-b825a9733794 req-2d155949-2d97-4c52-a758-6fec2fc16332 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Detach interface failed, port_id=623f4a68-c81d-4e52-87ea-4593ab6b3074, reason: Instance 29c1b984-b059-4a9c-8137-59391b5990bf could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:23 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Deleted allocations for instance 29c1b984-b059-4a9c-8137-59391b5990bf
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] Acquiring lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] Lock "29c1b984-b059-4a9c-8137-59391b5990bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] No waiting events found dispatching network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:54:23 user nova-compute[72954]: WARNING nova.compute.manager [req-9fcaee3d-2e9a-4ef2-8117-a6c46db049f2 req-4920eb01-c79b-46b6-9e0e-1d63bfba8c36 service nova] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Received unexpected event network-vif-plugged-623f4a68-c81d-4e52-87ea-4593ab6b3074 for instance with vm_state deleted and task_state None.
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00fcf51e-ed94-4e73-b0e4-df4ef4c233c3 tempest-SnapshotDataIntegrityTests-225866483 tempest-SnapshotDataIntegrityTests-225866483-project-member] Lock "29c1b984-b059-4a9c-8137-59391b5990bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:23 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:24 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8317MB free_disk=25.205585479736328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d4cd0f5d-19ba-4977-89c9-59b2e5876672 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:54:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:54:25 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:54:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-changed-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Refreshing instance network info cache due to event network-changed-08b10aba-9043-47f2-b117-72911e2eedc1. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] Acquiring lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] Acquired lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Refreshing network info cache for port 08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:54:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updated VIF entry in instance network info cache for port 08b10aba-9043-47f2-b117-72911e2eedc1. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-bb6868de-bb79-46d6-9935-3a245eb3d1de req-bfdb4402-b6db-4b24-bd18-bf9338988986 service nova] Releasing lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:29 user nova-compute[72954]: INFO nova.compute.manager [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attaching volume 17c29f45-1092-47b2-aa7c-4f42536781c4 to /dev/vdb
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.utils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[782cee95-6d61-4302-83c6-b7bc198aba5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae96fc3-5be7-415a-b7ab-046a5da821f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3150308-036f-4deb-99ea-393d3ca80e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf32b8-dad4-4217-85ab-ee6516a0eaf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:54:29 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9936d3-90e1-4957-a538-e7a4a0eb39e0]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG os_brick.utils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating existing volume attachment record: 0c072747-cf95-4f31-939f-82c2eeb1c844 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:54:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:54:33 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:54:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:54:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9949}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:54:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:54:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:36 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871661.8475342, 29c1b984-b059-4a9c-8137-59391b5990bf => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:54:36 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] VM Stopped (Lifecycle Event)
Sep 04 23:54:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-54279bb1-ab24-47f0-865d-cbdacff5bef7 None None] [instance: 29c1b984-b059-4a9c-8137-59391b5990bf] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:54:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUfNsHJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:54:43 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:54:43 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:54:43 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21358630-b1b6-4455-866d-3ec8e0d3b7e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:54:43 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7879a0-8464-4b72-bce7-f9ac81195b20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4] added
Sep 04 23:54:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1fc653-0a48-4ae9-aeee-bb39b24b67ad]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2251392b-8a0a-42a0-b94e-8b6e3525e97b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUfNsHJx {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUfNsHJx" returned: 0 in 0.138s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff68b57-e290-4335-a3f2-fda11ad5a2ce]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUfNsHJx'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb3debc-4265-44e1-a1a4-4cbba5c48726]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[34534433-5285-4141-a9b0-5010dd65cf87]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:54:43 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:54:43 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:54:43 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:54:43 user nova-compute[72954]: 
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[14039c2d-c03d-413b-a75d-53bd2adef899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260]
Sep 04 23:54:43 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260] successful.
Sep 04 23:54:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8f4547-97d0-4780-b4fe-bdfbb56bef5c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2796c01-cb2b-4d4d-8bc2-58f0f74af5d0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:54:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:54:43 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afa650-0bc6-44eb-a3cc-d20f6e47d36b]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUfNsHJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26638643066326631', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638643066326631', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:44 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:54:44 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:54:44 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:54:44 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:54:44 user nova-compute[72954]:   <serial>17c29f45-1092-47b2-aa7c-4f42536781c4</serial>
Sep 04 23:54:44 user nova-compute[72954]: </disk>
Sep 04 23:54:44 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:54:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:54:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:54:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No VIF found with MAC fa:16:3e:23:d8:e9, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:54:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4583700e-77d1-4573-8394-8a4e45f3e8e1 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.964s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:54:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:54:50 user nova-compute[72954]: INFO nova.compute.manager [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attaching volume b315cac7-8357-452e-bf98-be29471724f7 to /dev/vdc
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.utils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228b7b4-3331-4797-b038-2fd91857abfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e8841-12b7-453e-b2c7-4884799d0895]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8917b3-8b6c-43b4-a12b-dc017136b31d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[101676c8-e8c7-4e0c-a59c-e8624a0b19b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:54:50 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:54:50 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9680e8-20e3-4adc-952d-4aa9a8203abb]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG os_brick.utils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:54:50 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating existing volume attachment record: 2ebec0b9-8968-40d2-893e-7864dacf6280 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:54:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:54:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILJQzRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:55:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:55:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:55:05 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ff5d9-9e03-411d-b4fd-a53d81e9bdbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:55:05 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10b7b7-8e80-458d-8b5b-3baffd987ad2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7] added
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[595fda65-a5e7-4fbc-88bf-1db6897e1642]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[52836667-a6dd-43cb-8a64-43f91b445de1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wILJQzRp {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wILJQzRp" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba08504-9b95-432f-af0a-872fc79b262e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wILJQzRp'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22306d5-0a76-46c8-98ba-8d22b6161d94]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c745cf02-9cf3-45a1-a7c5-0348dc18cf9e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c46266-d58c-4bc9-9674-90c5c246b264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260]
Sep 04 23:55:05 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260] successful.
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8379fe-bd82-4141-8e7b-c1f4feb57412]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d56886-06cb-442a-b4d4-36b6edc71045]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)
Sep 04 23:55:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:55:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:06 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:06 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b1426-f24e-467d-9857-217599168189]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:06 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:55:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILJQzRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:55:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23236633438343634', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236633438343634', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.objects.instance [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:55:07 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:55:07 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:55:07 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:55:07 user nova-compute[72954]:   <serial>b315cac7-8357-452e-bf98-be29471724f7</serial>
Sep 04 23:55:07 user nova-compute[72954]: </disk>
Sep 04 23:55:07 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] No VIF found with MAC fa:16:3e:23:d8:e9, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:55:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-1c5ea4d7-6b51-4a02-bcb0-ec1ff9b21d2b tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.461s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:08 user nova-compute[72954]: INFO nova.compute.manager [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Detaching volume b315cac7-8357-452e-bf98-be29471724f7
Sep 04 23:55:08 user nova-compute[72954]: INFO nova.virt.block_device [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attempting to driver detach volume b315cac7-8357-452e-bf98-be29471724f7 from mountpoint /dev/vdc
Sep 04 23:55:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Attempting to detach device vdc from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:55:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:55:08 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:55:08 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:55:08 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:55:08 user nova-compute[72954]:   <serial>b315cac7-8357-452e-bf98-be29471724f7</serial>
Sep 04 23:55:08 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:55:08 user nova-compute[72954]: </disk>
Sep 04 23:55:08 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:55:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully detached device vdc from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the persistent domain config.
Sep 04 23:55:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:55:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:55:08 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:55:08 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:55:08 user nova-compute[72954]:   <target dev="vdc" bus="virtio"/>
Sep 04 23:55:08 user nova-compute[72954]:   <serial>b315cac7-8357-452e-bf98-be29471724f7</serial>
Sep 04 23:55:08 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Sep 04 23:55:08 user nova-compute[72954]: </disk>
Sep 04 23:55:08 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871709.2220511, de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:55:09 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully detached device vdc from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the live domain config.
Sep 04 23:55:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wILJQzRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:55:09 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ecb4a4-82c5-4877-9b9a-7016af12f2cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bbc10b-7f8c-4fd0-bd9b-84f242379b16]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:09 user nova-compute[72954]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)
Sep 04 23:55:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:09 user nova-compute[72954]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 (non-flash)
Sep 04 23:55:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1184cfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2537f-4e00-4a3c-8d0b-166747ea2c5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5632ab34-522b-446b-95ac-d8121aa1abd7]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4971ac3-f335-4ddd-a361-3e8ee5f37d78]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a827e28-70ae-41ec-b30f-1c122218a49f]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b54f6-e857-4997-a99f-7aa45f6c500b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108bbb4-4cc4-4462-b8bb-daccbf64e275]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260]
Sep 04 23:55:09 user nova-compute[72954]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7, portal: 172.16.0.220,3260] successful.
Sep 04 23:55:09 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b315cac7-8357-452e-bf98-be29471724f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ff261-f537-48f9-8bfc-a0d3d1b27b76]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== disconnect_volume: return (283ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:55:09 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:55:10 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bc1d9700-d21c-4cca-ac9f-b40a4b72a612 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.911s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:24 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:24 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:55:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:55:26 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=25.172393798828125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d4cd0f5d-19ba-4977-89c9-59b2e5876672 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:27 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 04 23:55:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 04 23:55:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:55:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [{"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:55:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:55:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:55:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:55:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:40 user nova-compute[72954]: INFO nova.compute.manager [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Unshelving
Sep 04 23:55:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_requests' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'numa_topology' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:55:40 user nova-compute[72954]: INFO nova.compute.claims [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Claim successful on node user
Sep 04 23:55:40 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:55:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:41 user nova-compute[72954]: INFO nova.network.neutron [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating port 45cdba26-7e2e-403f-8528-633b4ba6754c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing instance network info cache due to event network-changed-45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] Acquiring lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:55:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:55:42 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Creating image(s)
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'trusted_certs' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] Acquired lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Refreshing network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG nova.objects.base [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ff615b48-6435-4381-b124-39fb2da7ea88> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG nova.virt.images [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] 4e781784-ec9c-44fc-b53a-a4c73d122965 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.part /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updated VIF entry in instance network info cache for port 45cdba26-7e2e-403f-8528-633b4ba6754c. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:55:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-32d9facd-b439-48d0-b138-1aa7a8598ad2 req-9b108e34-784a-4c71-9187-29f412d74445 service nova] Releasing lock "refresh_cache-ff615b48-6435-4381-b124-39fb2da7ea88" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.part /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.converted" returned: 0 in 0.558s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.172s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json" returned: 0 in 0.170s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a,backing_fmt=raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a,backing_fmt=raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk 1073741824" returned: 0 in 0.048s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "9f17ffc44eceff87b9af19c4dde627cf4cb6278a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'migration_context' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:44 user nova-compute[72954]: DEBUG nova.objects.base [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ff615b48-6435-4381-b124-39fb2da7ea88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:55:44 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Rebasing disk image.
Sep 04 23:55:44 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb -F raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb -F raw /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk" returned: 0 in 2.036s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Ensure instance console log exists: /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start _get_guest_xml network_info=[{"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2882de5e8679b009aa4567124b0b719f',container_format='bare',created_at=2023-09-04T23:53:48Z,direct_url=<?>,disk_format='qcow2',id=4e781784-ec9c-44fc-b53a-a4c73d122965,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1568904586-shelved',owner='c910f268091a4c1090fb8adc3942c928',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:53:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:55:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:55:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2882de5e8679b009aa4567124b0b719f',container_format='bare',created_at=2023-09-04T23:53:48Z,direct_url=<?>,disk_format='qcow2',id=4e781784-ec9c-44fc-b53a-a4c73d122965,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1568904586-shelved',owner='c910f268091a4c1090fb8adc3942c928',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:53:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.objects.base [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ff615b48-6435-4381-b124-39fb2da7ea88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='4e781784-ec9c-44fc-b53a-a4c73d122965',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1637223520',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:53:52.246188',shelved_host='user',shelved_image_id='4e781784-ec9c-44fc-b53a-a4c73d122965'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.objects.instance [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'pci_devices' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.objects.base [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Object Instance<ff615b48-6435-4381-b124-39fb2da7ea88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:55:47 user nova-compute[72954]:   <uuid>ff615b48-6435-4381-b124-39fb2da7ea88</uuid>
Sep 04 23:55:47 user nova-compute[72954]:   <name>instance-00000025</name>
Sep 04 23:55:47 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:55:47 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:55:47 user nova-compute[72954]:   <metadata>
Sep 04 23:55:47 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:55:47 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1568904586</nova:name>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:55:47</nova:creationTime>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:55:47 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:55:47 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:owner>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:user uuid="22815594f2334a5aa727b3aab115af7f">tempest-AttachVolumeShelveTestJSON-966339939-project-member</nova:user>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:project uuid="c910f268091a4c1090fb8adc3942c928">tempest-AttachVolumeShelveTestJSON-966339939</nova:project>
Sep 04 23:55:47 user nova-compute[72954]:       </nova:owner>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:root type="image" uuid="4e781784-ec9c-44fc-b53a-a4c73d122965"/>
Sep 04 23:55:47 user nova-compute[72954]:       <nova:ports>
Sep 04 23:55:47 user nova-compute[72954]:         <nova:port uuid="45cdba26-7e2e-403f-8528-633b4ba6754c">
Sep 04 23:55:47 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 04 23:55:47 user nova-compute[72954]:         </nova:port>
Sep 04 23:55:47 user nova-compute[72954]:       </nova:ports>
Sep 04 23:55:47 user nova-compute[72954]:     </nova:instance>
Sep 04 23:55:47 user nova-compute[72954]:   </metadata>
Sep 04 23:55:47 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:55:47 user nova-compute[72954]:     <system>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="serial">ff615b48-6435-4381-b124-39fb2da7ea88</entry>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="uuid">ff615b48-6435-4381-b124-39fb2da7ea88</entry>
Sep 04 23:55:47 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:55:47 user nova-compute[72954]:     </system>
Sep 04 23:55:47 user nova-compute[72954]:   </sysinfo>
Sep 04 23:55:47 user nova-compute[72954]:   <os>
Sep 04 23:55:47 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:55:47 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:55:47 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:55:47 user nova-compute[72954]:   </os>
Sep 04 23:55:47 user nova-compute[72954]:   <features>
Sep 04 23:55:47 user nova-compute[72954]:     <acpi/>
Sep 04 23:55:47 user nova-compute[72954]:     <apic/>
Sep 04 23:55:47 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:55:47 user nova-compute[72954]:   </features>
Sep 04 23:55:47 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:55:47 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:55:47 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:55:47 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:55:47 user nova-compute[72954]:   </clock>
Sep 04 23:55:47 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:55:47 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:55:47 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:55:47 user nova-compute[72954]:   </cpu>
Sep 04 23:55:47 user nova-compute[72954]:   <devices>
Sep 04 23:55:47 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:55:47 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:55:47 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk"/>
Sep 04 23:55:47 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:55:47 user nova-compute[72954]:     </disk>
Sep 04 23:55:47 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:55:47 user nova-compute[72954]:       <mac address="fa:16:3e:40:54:94"/>
Sep 04 23:55:47 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:55:47 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:55:47 user nova-compute[72954]:       <target dev="tap45cdba26-7e"/>
Sep 04 23:55:47 user nova-compute[72954]:     </interface>
Sep 04 23:55:47 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:55:47 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/console.log" append="off"/>
Sep 04 23:55:47 user nova-compute[72954]:     </serial>
Sep 04 23:55:47 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:55:47 user nova-compute[72954]:     <video>
Sep 04 23:55:47 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:55:47 user nova-compute[72954]:     </video>
Sep 04 23:55:47 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:55:47 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:55:47 user nova-compute[72954]:     </rng>
Sep 04 23:55:47 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:55:47 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:55:47 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:55:47 user nova-compute[72954]:     </memballoon>
Sep 04 23:55:47 user nova-compute[72954]:   </devices>
Sep 04 23:55:47 user nova-compute[72954]: </domain>
Sep 04 23:55:47 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='4e781784-ec9c-44fc-b53a-a4c73d122965',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1637223520',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:51:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member',shelved_at='2023-09-04T23:53:52.246188',shelved_host='user',shelved_image_id='4e781784-ec9c-44fc-b53a-a4c73d122965'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG os_vif [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45cdba26-7e, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45cdba26-7e, col_values=(('external_ids', {'iface-id': '45cdba26-7e2e-403f-8528-633b4ba6754c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:54:94', 'vm-uuid': 'ff615b48-6435-4381-b124-39fb2da7ea88'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:47 user nova-compute[72954]: INFO os_vif [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e')
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:55:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] No VIF found with MAC fa:16:3e:40:54:94, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:55:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:55:49 user nova-compute[72954]: WARNING nova.compute.manager [req-73cab0b7-8c1e-4aa5-bf1e-d6d242384c55 req-88e3617c-d26d-4e08-8d77-64a235abeb71 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state shelved_offloaded and task_state spawning.
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.objects.instance [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871751.191725, ff615b48-6435-4381-b124-39fb2da7ea88 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Resumed (Lifecycle Event)
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance spawned successfully.
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871751.1934917, ff615b48-6435-4381-b124-39fb2da7ea88 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Started (Lifecycle Event)
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:51 user nova-compute[72954]: INFO nova.compute.manager [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Attaching volume 15d0bd9a-38fd-4757-a9db-771f9f87b1bd to /dev/vdb
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.utils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ab6f6-3a0e-45f1-8073-fa35c51c6681]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaf5c72-ff6b-4bf5-8ebc-07beb6916631]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5bd51f-8813-4d73-b2c1-60ae9e026892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f62ae6a-443a-4281-b696-9b974d2268d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:55:51 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2c17a1-110b-4038-9dfe-a04343b01a78]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG os_brick.utils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating existing volume attachment record: 7f6a3d14-df33-448e-a48d-cce8b5f5fcdb {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-fea55c4d-596d-4101-a61a-90f5ba36998f tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:55:51 user nova-compute[72954]: WARNING nova.compute.manager [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state active and task_state None.
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing instance network info cache due to event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG nova.network.neutron [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:55:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated VIF entry in instance network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:55:52 user nova-compute[72954]: DEBUG nova.network.neutron [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:55:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6af52117-f887-4ca6-b79e-4af0d644387b req-b73b0054-cd0d-4973-bfa7-76866d282370 service nova] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:55:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:55:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:55:59 user nova-compute[72954]: INFO nova.compute.manager [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Detaching volume 17c29f45-1092-47b2-aa7c-4f42536781c4
Sep 04 23:55:59 user nova-compute[72954]: INFO nova.virt.block_device [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Attempting to driver detach volume 17c29f45-1092-47b2-aa7c-4f42536781c4 from mountpoint /dev/vdb
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Attempting to detach device vdb from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:55:59 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:55:59 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:55:59 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:55:59 user nova-compute[72954]:   <serial>17c29f45-1092-47b2-aa7c-4f42536781c4</serial>
Sep 04 23:55:59 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:55:59 user nova-compute[72954]: </disk>
Sep 04 23:55:59 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:55:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully detached device vdb from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the persistent domain config.
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:55:59 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:55:59 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:55:59 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:55:59 user nova-compute[72954]:   <serial>17c29f45-1092-47b2-aa7c-4f42536781c4</serial>
Sep 04 23:55:59 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:55:59 user nova-compute[72954]: </disk>
Sep 04 23:55:59 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871759.7879698, de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:55:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully detached device vdb from instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 from the live domain config.
Sep 04 23:55:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUfNsHJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:55:59 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea94ccf0-09ba-4fe0-9bce-766e1d9a350c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3051fba-cefb-43ef-881d-ada0b6e75703]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:59 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 (non-flash)
Sep 04 23:55:59 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183f0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c01d88a-dbe5-44e3-bab6-6b34379e73a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62ac89-5e05-4148-82a4-28873b7d0465]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd40744-f078-4618-aa3b-ddc85b212faf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da4c344-3a00-47bf-a422-cd90d7285456]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:55:59 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5076492-e80e-4268-8016-f97c0c25862e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b74d0-d199-48b3-9d58-142ac3974a56]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260]
Sep 04 23:56:00 user nova-compute[72954]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4, portal: 172.16.0.220,3260] successful.
Sep 04 23:56:00 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c29f45-1092-47b2-aa7c-4f42536781c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcbf1c4-2399-4684-ac04-72f152f0b90d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] <== disconnect_volume: return (281ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:56:00 user nova-compute[72954]: DEBUG nova.objects.instance [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'flavor' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:56:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-5df1a05d-3da9-4843-915f-c1de1aa706d8 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:04 user nova-compute[72954]: INFO nova.compute.manager [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Terminating instance
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-unplugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] No waiting events found dispatching network-vif-unplugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.compute.manager [req-03a2caac-f91a-4532-b1b5-48a5960669a9 req-befed832-ef77-4adb-a7e0-d5c66f33b78d service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-unplugged-03872f3b-7b14-4d18-8bca-bc5a04b624db for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLVsqOKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:56:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:56:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:56:05 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c2cfea-9e81-4ffb-9e85-769c1d410510]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:56:05 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b094897-ff51-4d37-b778-18c231ab93c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd] added
Sep 04 23:56:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e858a-d06a-45f9-8b35-0acb9f26fe3c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e3c90-6985-498e-8b79-7313690d51ff]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLVsqOKp {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLVsqOKp" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40fad0-d07c-4ecd-8657-4c6f34ad2973]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLVsqOKp'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bad2e5c-894d-4ea1-8eaa-1df4984d3ed7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9118ae05-2ffc-4789-8447-1dd224094c17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:56:05 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:56:05 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:56:05 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:56:05 user nova-compute[72954]: 
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ac884-ea2b-4451-9af9-f216033c2477]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260]
Sep 04 23:56:05 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260] successful.
Sep 04 23:56:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Instance destroyed successfully.
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lazy-loading 'resources' on Instance uuid d4cd0f5d-19ba-4977-89c9-59b2e5876672 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56005851-e41b-4ddc-86ca-349f4aa7f09f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1351127936',display_name='tempest-VolumesActionsTest-instance-1351127936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1351127936',id=40,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bedcd16ca304debb5faa75416c3aac4',ramdisk_id='',reservation_id='r-pdu2pnem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2002974610',owner_user_name='tempest-VolumesActionsTest-2002974610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:54:21Z,user_data=None,user_id='ca716b5c013447f7a1742bbec8fb98bd',uuid=d4cd0f5d-19ba-4977-89c9-59b2e5876672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converting VIF {"id": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "address": "fa:16:3e:c7:a7:59", "network": {"id": "43b99d71-dfd9-44d8-816d-2199a4efbbb1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-287344600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bedcd16ca304debb5faa75416c3aac4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03872f3b-7b", "ovs_interfaceid": "03872f3b-7b14-4d18-8bca-bc5a04b624db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_vif [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03872f3b-7b, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb2cfa-5eb1-4e09-b739-ebb01a7709ee]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)
Sep 04 23:56:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)
Sep 04 23:56:05 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:56:05 user nova-compute[72954]: INFO os_vif [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:a7:59,bridge_name='br-int',has_traffic_filtering=True,id=03872f3b-7b14-4d18-8bca-bc5a04b624db,network=Network(43b99d71-dfd9-44d8-816d-2199a4efbbb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03872f3b-7b')
Sep 04 23:56:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Deleting instance files /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672_del
Sep 04 23:56:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Deletion of /opt/stack/data/nova/instances/d4cd0f5d-19ba-4977-89c9-59b2e5876672_del complete
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d682a4c3-eb85-4275-8e4b-06c8127e0748]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLVsqOKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:56:05 user nova-compute[72954]: INFO nova.compute.manager [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Took 0.90 seconds to destroy the instance on the hypervisor.
Sep 04 23:56:05 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:56:05 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:56:06 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Took 0.42 seconds to deallocate network for instance.
Sep 04 23:56:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:06 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Deleted allocations for instance d4cd0f5d-19ba-4977-89c9-59b2e5876672
Sep 04 23:56:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23534356464623961', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534356464623961', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.objects.instance [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:56:06 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:56:06 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:56:06 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:56:06 user nova-compute[72954]:   <serial>15d0bd9a-38fd-4757-a9db-771f9f87b1bd</serial>
Sep 04 23:56:06 user nova-compute[72954]: </disk>
Sep 04 23:56:06 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:56:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bafc3b50-d68f-4614-a40b-7970833345ea tempest-VolumesActionsTest-2002974610 tempest-VolumesActionsTest-2002974610-project-member] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No VIF found with MAC fa:16:3e:b9:e1:bf, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-be397a77-72d5-4bc8-8a58-1bce258cf599 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.040s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] Acquiring lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] Lock "d4cd0f5d-19ba-4977-89c9-59b2e5876672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] No waiting events found dispatching network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:56:07 user nova-compute[72954]: WARNING nova.compute.manager [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received unexpected event network-vif-plugged-03872f3b-7b14-4d18-8bca-bc5a04b624db for instance with vm_state deleted and task_state None.
Sep 04 23:56:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-0fa93563-12ed-4db4-ae64-0a751f7bde8e req-4593231c-232b-4548-a891-e8b48ee68a07 service nova] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Received event network-vif-deleted-03872f3b-7b14-4d18-8bca-bc5a04b624db {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:10 user nova-compute[72954]: INFO nova.compute.manager [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Detaching volume 15d0bd9a-38fd-4757-a9db-771f9f87b1bd
Sep 04 23:56:10 user nova-compute[72954]: INFO nova.virt.block_device [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Attempting to driver detach volume 15d0bd9a-38fd-4757-a9db-771f9f87b1bd from mountpoint /dev/vdb
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Attempting to detach device vdb from instance b814f212-ae45-49c1-8101-2d86f3c970e0 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:56:10 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:56:10 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:56:10 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:56:10 user nova-compute[72954]:   <serial>15d0bd9a-38fd-4757-a9db-771f9f87b1bd</serial>
Sep 04 23:56:10 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:56:10 user nova-compute[72954]: </disk>
Sep 04 23:56:10 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:56:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully detached device vdb from instance b814f212-ae45-49c1-8101-2d86f3c970e0 from the persistent domain config.
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b814f212-ae45-49c1-8101-2d86f3c970e0 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:56:10 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:56:10 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 04 23:56:10 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:56:10 user nova-compute[72954]:   <serial>15d0bd9a-38fd-4757-a9db-771f9f87b1bd</serial>
Sep 04 23:56:10 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:56:10 user nova-compute[72954]: </disk>
Sep 04 23:56:10 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871770.527777, b814f212-ae45-49c1-8101-2d86f3c970e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:56:10 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully detached device vdb from instance b814f212-ae45-49c1-8101-2d86f3c970e0 from the live domain config.
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLVsqOKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:56:10 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[810efe72-ae49-4135-bdc5-e8be030e4f11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62e253-b977-4f91-9e3d-622d03c6ce24]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)
Sep 04 23:56:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd (non-flash)
Sep 04 23:56:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13811dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66c305-fdd9-425b-b16e-2e7a76c0ed30]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b667e7-d862-47b0-a886-7dded1fb68c4]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a33d5-4908-453f-b13d-5999e7e13a0a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b5bd9-78f8-4680-a02b-4464381f6e90]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6c0f71-4404-4362-92d6-cd81b143f96c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39af34-9af2-4f28-8898-c9259d0145aa]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260]
Sep 04 23:56:10 user nova-compute[72954]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd, portal: 172.16.0.220,3260] successful.
Sep 04 23:56:10 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15d0bd9a-38fd-4757-a9db-771f9f87b1bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffdc1b-a62e-4794-82d4-b819a3683ce7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== disconnect_volume: return (262ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:56:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:11 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:56:11 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d78c4d31-86c8-4306-bc7b-457c3ef7c650 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:20 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871765.7818058, d4cd0f5d-19ba-4977-89c9-59b2e5876672 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:56:20 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] VM Stopped (Lifecycle Event)
Sep 04 23:56:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2d4dcbdb-7f45-438a-81ac-3a1af36ead16 None None] [instance: d4cd0f5d-19ba-4977-89c9-59b2e5876672] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:56:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:25 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:56:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:56:27 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.164993286132812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ff615b48-6435-4381-b124-39fb2da7ea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:56:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:56:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:56:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:56:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:56:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:56:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:49 user nova-compute[72954]: INFO nova.compute.manager [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Terminating instance
Sep 04 23:56:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-unplugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] No waiting events found dispatching network-vif-unplugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:56:49 user nova-compute[72954]: DEBUG nova.compute.manager [req-20d9f01b-3506-44fc-843c-3db948fd551b req-2ba8f6ba-c51a-473c-9152-a242aadca81f service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-unplugged-08b10aba-9043-47f2-b117-72911e2eedc1 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Instance destroyed successfully.
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lazy-loading 'resources' on Instance uuid de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1999200719',display_name='tempest-TestServerVolumeAttachmentScenario-server-1999200719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1999200719',id=38,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmeWsPU+g9/XOXxnYl3FlWMloMqgJCz+NDszFcnHcXBf6nE97g3h9qzTXLZgIrN3hapFkafB8C7DJ3aqVjMWUYP7iflv7xr2fhBL1QqZXPxZOuXfImJAQ2cMgbi2CWr5w==',key_name='tempest-keypair-569245018',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:52:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c295760b33f94d48b94ec62442784e0f',ramdisk_id='',reservation_id='r-cmtftert',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-575760748',owner_user_name='tempest-TestServerVolumeAttachmentScenario-575760748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e74525debeb4cc6b7ef76391a758324',uuid=de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converting VIF {"id": "08b10aba-9043-47f2-b117-72911e2eedc1", "address": "fa:16:3e:23:d8:e9", "network": {"id": "44425636-20a7-45b4-9d8c-4862ebbc9d8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-14265174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c295760b33f94d48b94ec62442784e0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b10aba-90", "ovs_interfaceid": "08b10aba-9043-47f2-b117-72911e2eedc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG os_vif [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08b10aba-90, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:56:50 user nova-compute[72954]: INFO os_vif [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=08b10aba-9043-47f2-b117-72911e2eedc1,network=Network(44425636-20a7-45b4-9d8c-4862ebbc9d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b10aba-90')
Sep 04 23:56:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Deleting instance files /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1_del
Sep 04 23:56:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Deletion of /opt/stack/data/nova/instances/de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1_del complete
Sep 04 23:56:50 user nova-compute[72954]: INFO nova.compute.manager [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Took 0.85 seconds to destroy the instance on the hypervisor.
Sep 04 23:56:50 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:56:50 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:56:51 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Took 0.79 seconds to deallocate network for instance.
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-3d37781e-b4e3-4167-9141-8bc709736df8 req-63bf78f4-0ffb-444f-9a62-58b72caedfe5 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-deleted-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:51 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Deleted allocations for instance de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-c58897c1-f6ba-461d-8bf6-4f9f65e30c06 tempest-TestServerVolumeAttachmentScenario-575760748 tempest-TestServerVolumeAttachmentScenario-575760748-project-member] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] Acquiring lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] Lock "de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:56:51 user nova-compute[72954]: DEBUG nova.compute.manager [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] No waiting events found dispatching network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:56:51 user nova-compute[72954]: WARNING nova.compute.manager [req-b76210be-da2f-4a23-87f4-752c14fa81cb req-85051a78-bcc5-46d5-99d5-562644b8eb52 service nova] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Received unexpected event network-vif-plugged-08b10aba-9043-47f2-b117-72911e2eedc1 for instance with vm_state deleted and task_state None.
Sep 04 23:56:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871810.379973, de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:57:05 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] VM Stopped (Lifecycle Event)
Sep 04 23:57:05 user nova-compute[72954]: DEBUG nova.compute.manager [None req-27558618-a177-4f04-b552-1d667f624856 None None] [instance: de4069a8-4c2c-4e6e-b8bd-e2dcc03f88a1] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:57:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:12 user nova-compute[72954]: DEBUG nova.compute.manager [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:12 user nova-compute[72954]: INFO nova.compute.manager [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] instance snapshotting
Sep 04 23:57:12 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Beginning live snapshot process
Sep 04 23:57:12 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json -f qcow2 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed.delta 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed.delta 1073741824" returned: 0 in 0.050s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Quiescing instance not available: QEMU guest agent is not enabled.
Sep 04 23:57:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] COPY block job progress, current cursor: 327680 final cursor: 75563008 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:57:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72954) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Sep 04 23:57:14 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Skipping quiescing instance: QEMU guest agent is not enabled.
Sep 04 23:57:15 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:57:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed.delta /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:15 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed.delta /opt/stack/data/nova/instances/snapshots/tmpr9ion9mn/0cb99ce8bb204cdf9ca57e89389f44ed" returned: 0 in 0.334s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:15 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Snapshot extracted, beginning image upload
Sep 04 23:57:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Snapshot image upload complete
Sep 04 23:57:18 user nova-compute[72954]: INFO nova.compute.manager [None req-c933173a-e2d9-4645-ae8d-ad60e6e43b8a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Took 5.72 seconds to snapshot the instance on the hypervisor.
Sep 04 23:57:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:57:20 user nova-compute[72954]: INFO nova.compute.claims [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Claim successful on node user
Sep 04 23:57:20 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:57:20 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:57:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.policy [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6a96b3e1f6f4599a8bb0920b6f7b2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4048c7fcec74d06aab1b693bed32639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:57:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Creating image(s)
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "/opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "/opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "/opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:21 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.part --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Successfully created port: 5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.part --force-share --output=json" returned: 0 in 0.276s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG nova.virt.images [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] f09fba18-a620-41f3-bc2b-ef7bfbe94b78 was qcow2, converting to raw {{(pid=72954) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG nova.privsep.utils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72954) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Sep 04 23:57:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.part /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.converted {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Successfully updated port: 5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquired lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing instance network info cache due to event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] Acquiring lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.part /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.converted" returned: 0 in 1.827s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.converted --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.268s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json" returned: 0 in 0.239s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:24 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc,backing_fmt=raw /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Releasing lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Instance network_info: |[{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] Acquired lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc,backing_fmt=raw /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk 1073741824" returned: 0 in 0.057s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "d2bdf2067c8c75c867eba2070811bb7a235f5dcc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Ensure instance console log exists: /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Start _get_guest_xml network_info=[{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4c64f060a0dae27f8411d4df446528fc',container_format='bare',created_at=2023-09-04T23:57:12Z,direct_url=<?>,disk_format='qcow2',id=f09fba18-a620-41f3-bc2b-ef7bfbe94b78,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-719376099',owner='f4048c7fcec74d06aab1b693bed32639',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:57:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': 'f09fba18-a620-41f3-bc2b-ef7bfbe94b78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:57:25 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:57:25 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4c64f060a0dae27f8411d4df446528fc',container_format='bare',created_at=2023-09-04T23:57:12Z,direct_url=<?>,disk_format='qcow2',id=f09fba18-a620-41f3-bc2b-ef7bfbe94b78,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-719376099',owner='f4048c7fcec74d06aab1b693bed32639',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-09-04T23:57:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834395797',display_name='tempest-TestStampPattern-server-1834395797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834395797',id=41,image_ref='f09fba18-a620-41f3-bc2b-ef7bfbe94b78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-bnqbgzx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b814f212-ae45-49c1-8101-2d86f3c970e0',image_min_disk='1',image_min_ram='0',image_owner_id='f4048c7fcec74d06aab1b693bed32639',image_owner_project_name='tempest-TestStampPattern-1760060686',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760060686-project-member',image_user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:57:21Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=028ea2d5-63ec-449b-aa67-0d15a97cec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'pci_devices' on Instance uuid 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:57:25 user nova-compute[72954]:   <uuid>028ea2d5-63ec-449b-aa67-0d15a97cec0c</uuid>
Sep 04 23:57:25 user nova-compute[72954]:   <name>instance-00000029</name>
Sep 04 23:57:25 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:57:25 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:57:25 user nova-compute[72954]:   <metadata>
Sep 04 23:57:25 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:57:25 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:name>tempest-TestStampPattern-server-1834395797</nova:name>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:57:25</nova:creationTime>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:57:25 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:57:25 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:owner>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:user uuid="a6a96b3e1f6f4599a8bb0920b6f7b2d4">tempest-TestStampPattern-1760060686-project-member</nova:user>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:project uuid="f4048c7fcec74d06aab1b693bed32639">tempest-TestStampPattern-1760060686</nova:project>
Sep 04 23:57:25 user nova-compute[72954]:       </nova:owner>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:root type="image" uuid="f09fba18-a620-41f3-bc2b-ef7bfbe94b78"/>
Sep 04 23:57:25 user nova-compute[72954]:       <nova:ports>
Sep 04 23:57:25 user nova-compute[72954]:         <nova:port uuid="5d3b440e-115a-4c23-9d19-f0b0da6d4d30">
Sep 04 23:57:25 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Sep 04 23:57:25 user nova-compute[72954]:         </nova:port>
Sep 04 23:57:25 user nova-compute[72954]:       </nova:ports>
Sep 04 23:57:25 user nova-compute[72954]:     </nova:instance>
Sep 04 23:57:25 user nova-compute[72954]:   </metadata>
Sep 04 23:57:25 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:57:25 user nova-compute[72954]:     <system>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="serial">028ea2d5-63ec-449b-aa67-0d15a97cec0c</entry>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="uuid">028ea2d5-63ec-449b-aa67-0d15a97cec0c</entry>
Sep 04 23:57:25 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:57:25 user nova-compute[72954]:     </system>
Sep 04 23:57:25 user nova-compute[72954]:   </sysinfo>
Sep 04 23:57:25 user nova-compute[72954]:   <os>
Sep 04 23:57:25 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:57:25 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:57:25 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:57:25 user nova-compute[72954]:   </os>
Sep 04 23:57:25 user nova-compute[72954]:   <features>
Sep 04 23:57:25 user nova-compute[72954]:     <acpi/>
Sep 04 23:57:25 user nova-compute[72954]:     <apic/>
Sep 04 23:57:25 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:57:25 user nova-compute[72954]:   </features>
Sep 04 23:57:25 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:57:25 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:57:25 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:57:25 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:57:25 user nova-compute[72954]:   </clock>
Sep 04 23:57:25 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:57:25 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:57:25 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:57:25 user nova-compute[72954]:   </cpu>
Sep 04 23:57:25 user nova-compute[72954]:   <devices>
Sep 04 23:57:25 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:57:25 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:57:25 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk"/>
Sep 04 23:57:25 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:57:25 user nova-compute[72954]:     </disk>
Sep 04 23:57:25 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:57:25 user nova-compute[72954]:       <mac address="fa:16:3e:c7:34:dd"/>
Sep 04 23:57:25 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:57:25 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:57:25 user nova-compute[72954]:       <target dev="tap5d3b440e-11"/>
Sep 04 23:57:25 user nova-compute[72954]:     </interface>
Sep 04 23:57:25 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:57:25 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/console.log" append="off"/>
Sep 04 23:57:25 user nova-compute[72954]:     </serial>
Sep 04 23:57:25 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:57:25 user nova-compute[72954]:     <video>
Sep 04 23:57:25 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:57:25 user nova-compute[72954]:     </video>
Sep 04 23:57:25 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:57:25 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:57:25 user nova-compute[72954]:     </rng>
Sep 04 23:57:25 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:57:25 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:57:25 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:57:25 user nova-compute[72954]:     </memballoon>
Sep 04 23:57:25 user nova-compute[72954]:   </devices>
Sep 04 23:57:25 user nova-compute[72954]: </domain>
Sep 04 23:57:25 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834395797',display_name='tempest-TestStampPattern-server-1834395797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834395797',id=41,image_ref='f09fba18-a620-41f3-bc2b-ef7bfbe94b78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-bnqbgzx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b814f212-ae45-49c1-8101-2d86f3c970e0',image_min_disk='1',image_min_ram='0',image_owner_id='f4048c7fcec74d06aab1b693bed32639',image_owner_project_name='tempest-TestStampPattern-1760060686',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760060686-project-member',image_user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:57:21Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=028ea2d5-63ec-449b-aa67-0d15a97cec0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG os_vif [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d3b440e-11, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d3b440e-11, col_values=(('external_ids', {'iface-id': '5d3b440e-115a-4c23-9d19-f0b0da6d4d30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:34:dd', 'vm-uuid': '028ea2d5-63ec-449b-aa67-0d15a97cec0c'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:25 user nova-compute[72954]: INFO os_vif [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11')
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No VIF found with MAC fa:16:3e:c7:34:dd, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updated VIF entry in instance network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:57:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4078bdae-3e34-45b4-a50c-6ef50c923154 req-88dc3169-6b4c-4043-9c74-bc1471bf212a service nova] Releasing lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] No waiting events found dispatching network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:57:26 user nova-compute[72954]: WARNING nova.compute.manager [req-ffb3c5e7-2d1c-45d5-bf16-ebd3ca86140d req-709c7cf6-c088-4ba8-9608-91d1612403ab service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received unexpected event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 for instance with vm_state building and task_state spawning.
Sep 04 23:57:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:57:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:57:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=24.058609008789062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance ff615b48-6435-4381-b124-39fb2da7ea88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871848.9247603, 028ea2d5-63ec-449b-aa67-0d15a97cec0c => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:57:28 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] VM Resumed (Lifecycle Event)
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:57:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Instance spawned successfully.
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:57:28 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:57:28 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871848.926882, 028ea2d5-63ec-449b-aa67-0d15a97cec0c => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:57:28 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] VM Started (Lifecycle Event)
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:57:29 user nova-compute[72954]: INFO nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Took 7.77 seconds to spawn the instance on the hypervisor.
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] No waiting events found dispatching network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:57:29 user nova-compute[72954]: WARNING nova.compute.manager [req-dc28d709-8831-4eec-82c5-512ac49294ca req-55dfcd19-d24f-40f1-b691-614b0a80dd52 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received unexpected event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 for instance with vm_state building and task_state spawning.
Sep 04 23:57:29 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:57:29 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:57:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:29 user nova-compute[72954]: INFO nova.compute.manager [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Took 8.44 seconds to build instance.
Sep 04 23:57:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2fd4aca0-e561-4587-8ab8-7d3b6735793a tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.549s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:30 user nova-compute[72954]: INFO nova.compute.manager [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Terminating instance
Sep 04 23:57:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-b955d4a1-d6ad-4371-a9b6-41ecf2b3a8f9 req-e6a95ee3-537f-4427-b1ac-d23311051c35 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-unplugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 04 23:57:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Instance destroyed successfully.
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.objects.instance [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lazy-loading 'resources' on Instance uuid ff615b48-6435-4381-b124-39fb2da7ea88 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568904586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568904586',id=37,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1X5P31RYgkOzXWDEt6QLUIOJ4DGcuYRvKiEQg4y4EE7cjNVVXbf71hKGMj5jxt+InDob53zAl+Oc7jwPyVikkSgrImtVXvxd6UnkgT+PCUopg/IupOaFjHSST0b80sKQ==',key_name='tempest-keypair-1637223520',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c910f268091a4c1090fb8adc3942c928',ramdisk_id='',reservation_id='r-bv4jz18a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-966339939',owner_user_name='tempest-AttachVolumeShelveTestJSON-966339939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22815594f2334a5aa727b3aab115af7f',uuid=ff615b48-6435-4381-b124-39fb2da7ea88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converting VIF {"id": "45cdba26-7e2e-403f-8528-633b4ba6754c", "address": "fa:16:3e:40:54:94", "network": {"id": "318961cf-28ab-4bda-9dd1-855b89fef809", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-994149882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c910f268091a4c1090fb8adc3942c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45cdba26-7e", "ovs_interfaceid": "45cdba26-7e2e-403f-8528-633b4ba6754c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG os_vif [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45cdba26-7e, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:31 user nova-compute[72954]: INFO os_vif [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:54:94,bridge_name='br-int',has_traffic_filtering=True,id=45cdba26-7e2e-403f-8528-633b4ba6754c,network=Network(318961cf-28ab-4bda-9dd1-855b89fef809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45cdba26-7e')
Sep 04 23:57:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Deleting instance files /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88_del
Sep 04 23:57:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Deletion of /opt/stack/data/nova/instances/ff615b48-6435-4381-b124-39fb2da7ea88_del complete
Sep 04 23:57:31 user nova-compute[72954]: INFO nova.compute.manager [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Took 0.94 seconds to destroy the instance on the hypervisor.
Sep 04 23:57:31 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 04 23:57:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-23ea0d27-da59-4d06-a857-ac2001081f5b req-0cfc294a-6f3d-4637-8712-70b6aea1e199 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-deleted-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:32 user nova-compute[72954]: INFO nova.compute.manager [req-23ea0d27-da59-4d06-a857-ac2001081f5b req-0cfc294a-6f3d-4637-8712-70b6aea1e199 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Neutron deleted interface 45cdba26-7e2e-403f-8528-633b4ba6754c; detaching it from the instance and deleting it from the info cache
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-23ea0d27-da59-4d06-a857-ac2001081f5b req-0cfc294a-6f3d-4637-8712-70b6aea1e199 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:57:32 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Took 0.86 seconds to deallocate network for instance.
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.compute.manager [req-23ea0d27-da59-4d06-a857-ac2001081f5b req-0cfc294a-6f3d-4637-8712-70b6aea1e199 service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Detach interface failed, port_id=45cdba26-7e2e-403f-8528-633b4ba6754c, reason: Instance ff615b48-6435-4381-b124-39fb2da7ea88 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:32 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Deleted allocations for instance ff615b48-6435-4381-b124-39fb2da7ea88
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-bd7fe430-a1b3-480f-b0b4-bc36273eb022 tempest-AttachVolumeShelveTestJSON-966339939 tempest-AttachVolumeShelveTestJSON-966339939-project-member] Lock "ff615b48-6435-4381-b124-39fb2da7ea88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] Acquiring lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] Lock "ff615b48-6435-4381-b124-39fb2da7ea88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] No waiting events found dispatching network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:57:33 user nova-compute[72954]: WARNING nova.compute.manager [req-1ae4c67e-1aa1-49cf-945a-c2a41fb0a1e5 req-82c3e5cd-7e67-420f-901b-8932bf35019f service nova] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Received unexpected event network-vif-plugged-45cdba26-7e2e-403f-8528-633b4ba6754c for instance with vm_state deleted and task_state None.
Sep 04 23:57:33 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:33 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:57:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 04 23:57:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:57:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:57:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:46 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693871851.583558, ff615b48-6435-4381-b124-39fb2da7ea88 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:57:46 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] VM Stopped (Lifecycle Event)
Sep 04 23:57:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-cd6d0d8a-b707-49a0-a4c8-03851e488d74 None None] [instance: ff615b48-6435-4381-b124-39fb2da7ea88] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:57:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:57:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:26 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:28 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.062808990478516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:58:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:58:32 user nova-compute[72954]: INFO nova.compute.claims [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Claim successful on node user
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:58:33 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:58:33 user nova-compute[72954]: INFO nova.virt.block_device [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Booting with volume f880bdba-49af-4bf8-ad54-fec4c0f2079c at /dev/vda
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.utils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.policy [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4b4395e34e548a0b2bf572e5217d070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9120760d601419b93f6d9b8ec092193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d69a1-aef3-4baa-9bc2-a4b16c0adcdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc7510d-99fb-4655-8653-52d758a12ed9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.078s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a2527-04d1-42b4-bb3c-55a77becbeb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bff18-81e5-46fc-8fb5-eebb2fef6a6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:58:33 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:58:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99d06ca-fe19-4944-90ad-4068457a8b1d]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG os_brick.utils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:58:33 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating existing volume attachment record: d9386c13-efd8-4d76-8a3a-dfebf6f461a6 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:58:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Successfully created port: b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:58:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Successfully updated port: b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing instance network info cache due to event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance network_info: |[{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated VIF entry in instance network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG nova.network.neutron [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e98a76bb-7013-40bc-9fc3-dd55bb29b595 req-eedff8e0-f202-4100-8783-3009927b2821 service nova] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:58:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Skipping network cache update for instance because it is Building. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9918}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:58:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:58:38 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:58:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:58:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:58:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:58:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Creating image(s)
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Ensure instance console log exists: /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start _get_guest_xml network_info=[{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04723ac0-4a7e-4365-ab31-0b7b7ba9959b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f880bdba-49af-4bf8-ad54-fec4c0f2079c', 'serial': 'f880bdba-49af-4bf8-ad54-fec4c0f2079c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd9386c13-efd8-4d76-8a3a-dfebf6f461a6', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:58:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:58:47 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:58:47 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:58:47 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95060217-991b-4664-9bb8-7ace54f06bb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:58:47 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74dc4d9-1440-4e06-886d-a20ae7a88fa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c] added
Sep 04 23:58:47 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec87094-3aa4-4a8d-85d6-c8153e82dcb2]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcccffd-34a2-415c-840a-33c22c1476a8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiIolWeP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiIolWeP" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00ec45-4bf2-4d46-894e-2ac6359efbda]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HiIolWeP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4173887-0a6b-45e8-ba7a-bda685bebb7c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b910c-d21a-4e97-9cb6-b7dbe4c2c7b3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:58:47 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:58:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 04 23:58:47 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:58:47 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 04 23:58:47 user nova-compute[72954]: 
Sep 04 23:58:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[545271fd-b4b8-409d-8d52-9a03f7f2a3d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]
Sep 04 23:58:48 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.
Sep 04 23:58:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed72cfa-0077-4219-8b8c-804ef8b5300b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39018f4-059b-4566-a571-d7d2c18e4b55]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:58:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:58:48 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffeab98-36b7-4c23-afb8-0c94b05fb3d9]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:58:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23438613562633061', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438613562633061', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA3U23sWkgh+8JH0UwhbFuiqxnqxSNXNBaiMRKNDkVghULcVEvTb/z6dH5JMYHN0lSUqERuPEKc5D/V6YJ7KV9XfBaddfab+J4uq4o/u7IlpTmVsPuVzQWOv/7I1OIjDA==',key_name='tempest-TestShelveInstance-962283649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:58:33Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'pci_devices' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:58:49 user nova-compute[72954]:   <uuid>04723ac0-4a7e-4365-ab31-0b7b7ba9959b</uuid>
Sep 04 23:58:49 user nova-compute[72954]:   <name>instance-0000002a</name>
Sep 04 23:58:49 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:58:49 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:58:49 user nova-compute[72954]:   <metadata>
Sep 04 23:58:49 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:58:49 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:58:49 user nova-compute[72954]:       <nova:name>tempest-TestShelveInstance-server-1949779981</nova:name>
Sep 04 23:58:49 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:58:47</nova:creationTime>
Sep 04 23:58:49 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:58:49 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:58:49 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:58:49 user nova-compute[72954]:       <nova:owner>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:user uuid="c4b4395e34e548a0b2bf572e5217d070">tempest-TestShelveInstance-146984119-project-member</nova:user>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:project uuid="e9120760d601419b93f6d9b8ec092193">tempest-TestShelveInstance-146984119</nova:project>
Sep 04 23:58:49 user nova-compute[72954]:       </nova:owner>
Sep 04 23:58:49 user nova-compute[72954]:       <nova:ports>
Sep 04 23:58:49 user nova-compute[72954]:         <nova:port uuid="b85bc9f7-653f-4b60-b649-3dcb99440e77">
Sep 04 23:58:49 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Sep 04 23:58:49 user nova-compute[72954]:         </nova:port>
Sep 04 23:58:49 user nova-compute[72954]:       </nova:ports>
Sep 04 23:58:49 user nova-compute[72954]:     </nova:instance>
Sep 04 23:58:49 user nova-compute[72954]:   </metadata>
Sep 04 23:58:49 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:58:49 user nova-compute[72954]:     <system>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="serial">04723ac0-4a7e-4365-ab31-0b7b7ba9959b</entry>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="uuid">04723ac0-4a7e-4365-ab31-0b7b7ba9959b</entry>
Sep 04 23:58:49 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:58:49 user nova-compute[72954]:     </system>
Sep 04 23:58:49 user nova-compute[72954]:   </sysinfo>
Sep 04 23:58:49 user nova-compute[72954]:   <os>
Sep 04 23:58:49 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:58:49 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:58:49 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:58:49 user nova-compute[72954]:   </os>
Sep 04 23:58:49 user nova-compute[72954]:   <features>
Sep 04 23:58:49 user nova-compute[72954]:     <acpi/>
Sep 04 23:58:49 user nova-compute[72954]:     <apic/>
Sep 04 23:58:49 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:58:49 user nova-compute[72954]:   </features>
Sep 04 23:58:49 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:58:49 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:58:49 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:58:49 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:58:49 user nova-compute[72954]:   </clock>
Sep 04 23:58:49 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:58:49 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:58:49 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:58:49 user nova-compute[72954]:   </cpu>
Sep 04 23:58:49 user nova-compute[72954]:   <devices>
Sep 04 23:58:49 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 04 23:58:49 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:58:49 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 04 23:58:49 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:58:49 user nova-compute[72954]:       <serial>f880bdba-49af-4bf8-ad54-fec4c0f2079c</serial>
Sep 04 23:58:49 user nova-compute[72954]:     </disk>
Sep 04 23:58:49 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:58:49 user nova-compute[72954]:       <mac address="fa:16:3e:11:87:8f"/>
Sep 04 23:58:49 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:58:49 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:58:49 user nova-compute[72954]:       <target dev="tapb85bc9f7-65"/>
Sep 04 23:58:49 user nova-compute[72954]:     </interface>
Sep 04 23:58:49 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:58:49 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b/console.log" append="off"/>
Sep 04 23:58:49 user nova-compute[72954]:     </serial>
Sep 04 23:58:49 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:58:49 user nova-compute[72954]:     <video>
Sep 04 23:58:49 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:58:49 user nova-compute[72954]:     </video>
Sep 04 23:58:49 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:58:49 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:58:49 user nova-compute[72954]:     </rng>
Sep 04 23:58:49 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:58:49 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:58:49 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:58:49 user nova-compute[72954]:     </memballoon>
Sep 04 23:58:49 user nova-compute[72954]:   </devices>
Sep 04 23:58:49 user nova-compute[72954]: </domain>
Sep 04 23:58:49 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA3U23sWkgh+8JH0UwhbFuiqxnqxSNXNBaiMRKNDkVghULcVEvTb/z6dH5JMYHN0lSUqERuPEKc5D/V6YJ7KV9XfBaddfab+J4uq4o/u7IlpTmVsPuVzQWOv/7I1OIjDA==',key_name='tempest-TestShelveInstance-962283649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:58:33Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG os_vif [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb85bc9f7-65, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb85bc9f7-65, col_values=(('external_ids', {'iface-id': 'b85bc9f7-653f-4b60-b649-3dcb99440e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:87:8f', 'vm-uuid': '04723ac0-4a7e-4365-ab31-0b7b7ba9959b'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:49 user nova-compute[72954]: INFO os_vif [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65')
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:58:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] No VIF found with MAC fa:16:3e:11:87:8f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:58:50 user nova-compute[72954]: WARNING nova.compute.manager [req-3eb07ab8-392f-4e9d-b8a3-f0e5a794b57c req-7d533f70-5491-45c9-ba97-2f6be8a9704d service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state building and task_state spawning.
Sep 04 23:58:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 04 23:58:51 user nova-compute[72954]: INFO nova.compute.claims [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Claim successful on node user
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 04 23:58:51 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 04 23:58:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.policy [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61e815f67e4f509e9e33e97201759c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f019505deedc4dcba8ef93923b81c192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 04 23:58:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Creating image(s)
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.197s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.233s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk 1073741824" returned: 0 in 0.083s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Successfully created port: f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:58:52 user nova-compute[72954]: WARNING nova.compute.manager [req-e39ab3ef-b610-424a-8f53-85cc2867a64e req-f68f8783-5ae2-4b8d-9a7d-5433f99d1053 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state building and task_state spawning.
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871932.8722508, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:58:52 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Resumed (Lifecycle Event)
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance spawned successfully.
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:53 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871932.8782043, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:58:53 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Started (Lifecycle Event)
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:58:53 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Cannot resize image /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Ensure instance console log exists: /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:53 user nova-compute[72954]: INFO nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Took 5.48 seconds to spawn the instance on the hypervisor.
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:53 user nova-compute[72954]: INFO nova.compute.manager [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Took 20.32 seconds to build instance.
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-473d3e8f-5377-4a17-bce8-d1cb6b798130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.425s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Successfully updated port: f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquired lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Releasing lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Instance network_info: |[{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Start _get_guest_xml network_info=[{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 04 23:58:53 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:53 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395860938',display_name='tempest-AttachVolumeNegativeTest-server-395860938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395860938',id=43,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3gA0vCF+ChG1KG3ujgW772+VFybJ19Uc1pXLhacJmHKxd1BPKojtHQyAX0Sltf5mPK4QEPaCYv37pgBxvTUX5HOXYJQ6n444UHjUxGZmVy5sOTeXhUOQCkqnkt+jHb6w==',key_name='tempest-keypair-808364904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-arvpu6md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] End _get_guest_xml xml=<domain type="kvm">
Sep 04 23:58:53 user nova-compute[72954]:   <uuid>4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29</uuid>
Sep 04 23:58:53 user nova-compute[72954]:   <name>instance-0000002b</name>
Sep 04 23:58:53 user nova-compute[72954]:   <memory>524288</memory>
Sep 04 23:58:53 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 04 23:58:53 user nova-compute[72954]:   <metadata>
Sep 04 23:58:53 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 04 23:58:53 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeNegativeTest-server-395860938</nova:name>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:creationTime>2023-09-04 23:58:53</nova:creationTime>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 04 23:58:53 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 04 23:58:53 user nova-compute[72954]:       </nova:flavor>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:owner>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:user uuid="ff61e815f67e4f509e9e33e97201759c">tempest-AttachVolumeNegativeTest-2127434441-project-member</nova:user>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:project uuid="f019505deedc4dcba8ef93923b81c192">tempest-AttachVolumeNegativeTest-2127434441</nova:project>
Sep 04 23:58:53 user nova-compute[72954]:       </nova:owner>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 04 23:58:53 user nova-compute[72954]:       <nova:ports>
Sep 04 23:58:53 user nova-compute[72954]:         <nova:port uuid="f7cd5981-72db-4481-bbfb-a68b7fadc4b3">
Sep 04 23:58:53 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Sep 04 23:58:53 user nova-compute[72954]:         </nova:port>
Sep 04 23:58:53 user nova-compute[72954]:       </nova:ports>
Sep 04 23:58:53 user nova-compute[72954]:     </nova:instance>
Sep 04 23:58:53 user nova-compute[72954]:   </metadata>
Sep 04 23:58:53 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 04 23:58:53 user nova-compute[72954]:     <system>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="serial">4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29</entry>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="uuid">4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29</entry>
Sep 04 23:58:53 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 04 23:58:53 user nova-compute[72954]:     </system>
Sep 04 23:58:53 user nova-compute[72954]:   </sysinfo>
Sep 04 23:58:53 user nova-compute[72954]:   <os>
Sep 04 23:58:53 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 04 23:58:53 user nova-compute[72954]:     <boot dev="hd"/>
Sep 04 23:58:53 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 04 23:58:53 user nova-compute[72954]:   </os>
Sep 04 23:58:53 user nova-compute[72954]:   <features>
Sep 04 23:58:53 user nova-compute[72954]:     <acpi/>
Sep 04 23:58:53 user nova-compute[72954]:     <apic/>
Sep 04 23:58:53 user nova-compute[72954]:     <vmcoreinfo/>
Sep 04 23:58:53 user nova-compute[72954]:   </features>
Sep 04 23:58:53 user nova-compute[72954]:   <clock offset="utc">
Sep 04 23:58:53 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 04 23:58:53 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 04 23:58:53 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 04 23:58:53 user nova-compute[72954]:   </clock>
Sep 04 23:58:53 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 04 23:58:53 user nova-compute[72954]:     <model>Nehalem</model>
Sep 04 23:58:53 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 04 23:58:53 user nova-compute[72954]:   </cpu>
Sep 04 23:58:53 user nova-compute[72954]:   <devices>
Sep 04 23:58:53 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 04 23:58:53 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 04 23:58:53 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk"/>
Sep 04 23:58:53 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 04 23:58:53 user nova-compute[72954]:     </disk>
Sep 04 23:58:53 user nova-compute[72954]:     <interface type="ethernet">
Sep 04 23:58:53 user nova-compute[72954]:       <mac address="fa:16:3e:c1:18:7f"/>
Sep 04 23:58:53 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:58:53 user nova-compute[72954]:       <mtu size="1442"/>
Sep 04 23:58:53 user nova-compute[72954]:       <target dev="tapf7cd5981-72"/>
Sep 04 23:58:53 user nova-compute[72954]:     </interface>
Sep 04 23:58:53 user nova-compute[72954]:     <serial type="pty">
Sep 04 23:58:53 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/console.log" append="off"/>
Sep 04 23:58:53 user nova-compute[72954]:     </serial>
Sep 04 23:58:53 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 04 23:58:53 user nova-compute[72954]:     <video>
Sep 04 23:58:53 user nova-compute[72954]:       <model type="virtio"/>
Sep 04 23:58:53 user nova-compute[72954]:     </video>
Sep 04 23:58:53 user nova-compute[72954]:     <rng model="virtio">
Sep 04 23:58:53 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 04 23:58:53 user nova-compute[72954]:     </rng>
Sep 04 23:58:53 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 04 23:58:53 user nova-compute[72954]:     <memballoon model="virtio">
Sep 04 23:58:53 user nova-compute[72954]:       <stats period="10"/>
Sep 04 23:58:53 user nova-compute[72954]:     </memballoon>
Sep 04 23:58:53 user nova-compute[72954]:   </devices>
Sep 04 23:58:53 user nova-compute[72954]: </domain>
Sep 04 23:58:53 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395860938',display_name='tempest-AttachVolumeNegativeTest-server-395860938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395860938',id=43,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3gA0vCF+ChG1KG3ujgW772+VFybJ19Uc1pXLhacJmHKxd1BPKojtHQyAX0Sltf5mPK4QEPaCYv37pgBxvTUX5HOXYJQ6n444UHjUxGZmVy5sOTeXhUOQCkqnkt+jHb6w==',key_name='tempest-keypair-808364904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-arvpu6md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-04T23:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG os_vif [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7cd5981-72, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7cd5981-72, col_values=(('external_ids', {'iface-id': 'f7cd5981-72db-4481-bbfb-a68b7fadc4b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:18:7f', 'vm-uuid': '4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:54 user nova-compute[72954]: INFO os_vif [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72')
Sep 04 23:58:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:c1:18:7f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-changed-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG nova.compute.manager [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Refreshing instance network info cache due to event network-changed-f7cd5981-72db-4481-bbfb-a68b7fadc4b3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] Acquiring lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] Acquired lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:58:54 user nova-compute[72954]: DEBUG nova.network.neutron [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Refreshing network info cache for port f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updated VIF entry in instance network info cache for port f7cd5981-72db-4481-bbfb-a68b7fadc4b3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG nova.network.neutron [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c33ccfa1-ac46-4952-b715-6e1412424b29 req-eea2c589-3041-4af3-b95c-078df1bdf9a5 service nova] Releasing lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:55 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] No waiting events found dispatching network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:58:55 user nova-compute[72954]: WARNING nova.compute.manager [req-fa357ba8-5c72-480e-8b50-ee04baca4f24 req-8aa32faa-b683-4c62-9d09-a9b3b4edffa2 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received unexpected event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 for instance with vm_state building and task_state spawning.
Sep 04 23:58:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] No waiting events found dispatching network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 04 23:58:57 user nova-compute[72954]: WARNING nova.compute.manager [req-a9fc627e-dfb2-48e8-acd1-6ca15a34ac60 req-67ddc27d-7e13-40df-b1b0-5e00cc88a132 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received unexpected event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 for instance with vm_state building and task_state spawning.
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871937.8398294, 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] VM Resumed (Lifecycle Event)
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Instance spawned successfully.
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693871937.841093, 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] VM Started (Lifecycle Event)
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 04 23:58:57 user nova-compute[72954]: INFO nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Took 5.80 seconds to spawn the instance on the hypervisor.
Sep 04 23:58:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 04 23:58:58 user nova-compute[72954]: INFO nova.compute.manager [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Took 6.45 seconds to build instance.
Sep 04 23:58:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-704af008-1c49-4cb9-91d8-8acf15cfeb29 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.542s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:58:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:59:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG nova.compute.manager [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing instance network info cache due to event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] Acquiring lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] Acquired lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updated VIF entry in instance network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 04 23:59:12 user nova-compute[72954]: DEBUG nova.network.neutron [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:59:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c7b27635-08a1-4ad1-870e-258c2d96bbf9 req-4466f125-0437-485c-9b53-994696ca824a service nova] Releasing lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG nova.objects.instance [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:59:14 user nova-compute[72954]: INFO nova.compute.manager [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Attaching volume 99b86b9c-afe4-4f22-8c52-80388c6e4711 to /dev/vdb
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.utils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c269b324-6e69-40eb-81ad-be0da4efe780]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd61f225-0504-43f7-a114-5418f6e7df8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901639a-90d6-4824-877b-8f79a913f340]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[743de49e-24f1-4d10-a559-d76991efa41e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 04 23:59:14 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 04 23:59:14 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33fe5a-a401-4b8d-9578-fc5a6950751e]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG os_brick.utils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:59:14 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating existing volume attachment record: 813baea5-b537-4158-92f3-01c55d133ef5 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 04 23:59:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYzFpXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:59:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:59:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:59:27 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df40141-c9cd-41ce-8505-9af69ab19d59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 04 23:59:27 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a7ae5d-a710-4918-bbf1-f04a30059bd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711] added
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367876d-a3f1-456f-86ba-e1afab2eae52]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868c62c-3303-46dc-8871-aac0480a64dc]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTYzFpXh {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTYzFpXh" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82b15e-cf3e-42be-849f-7a90be6e856a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTYzFpXh'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d14024-c8e4-4794-928b-404af4ab7201]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6eaa88-5745-40a7-b71b-48dc39a2b85d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc589d-d36d-41b0-8eff-8af0fc526346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260]
Sep 04 23:59:27 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260] successful.
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a0f35d-f846-474e-969b-8d67d0451764]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd5f77-4172-47f2-93d1-88feea801a16]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:27 user nova-compute[72954]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:27 user nova-compute[72954]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)
Sep 04 23:59:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 04 23:59:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd41086-6831-4060-bf7b-2d271f862df8]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:59:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYzFpXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23835303936636166', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835303936636166', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] attach device xml: <disk type="block" device="disk">
Sep 04 23:59:29 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:59:29 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:59:29 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:59:29 user nova-compute[72954]:   <serial>99b86b9c-afe4-4f22-8c52-80388c6e4711</serial>
Sep 04 23:59:29 user nova-compute[72954]: </disk>
Sep 04 23:59:29 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] No VIF found with MAC fa:16:3e:c7:34:dd, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-691be0bd-55df-4900-8d50-8527d7249528 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.527s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 04 23:59:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:59:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8262MB free_disk=25.023086547851562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 04723ac0-4a7e-4365-ab31-0b7b7ba9959b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 04 23:59:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 04 23:59:31 user nova-compute[72954]: INFO nova.compute.manager [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Detaching volume 99b86b9c-afe4-4f22-8c52-80388c6e4711
Sep 04 23:59:31 user nova-compute[72954]: INFO nova.virt.block_device [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Attempting to driver detach volume 99b86b9c-afe4-4f22-8c52-80388c6e4711 from mountpoint /dev/vdb
Sep 04 23:59:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Attempting to detach device vdb from instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:59:31 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:59:31 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:59:31 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:59:31 user nova-compute[72954]:   <serial>99b86b9c-afe4-4f22-8c52-80388c6e4711</serial>
Sep 04 23:59:31 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:59:31 user nova-compute[72954]: </disk>
Sep 04 23:59:31 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:59:31 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully detached device vdb from instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c from the persistent domain config.
Sep 04 23:59:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] detach device xml: <disk type="block" device="disk">
Sep 04 23:59:31 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 04 23:59:31 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 04 23:59:31 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 04 23:59:31 user nova-compute[72954]:   <serial>99b86b9c-afe4-4f22-8c52-80388c6e4711</serial>
Sep 04 23:59:31 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 04 23:59:31 user nova-compute[72954]: </disk>
Sep 04 23:59:31 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693871972.045209, 028ea2d5-63ec-449b-aa67-0d15a97cec0c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 04 23:59:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully detached device vdb from instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c from the live domain config.
Sep 04 23:59:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYzFpXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 04 23:59:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf972e-51c2-4721-ade0-5adc86253a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cefdff2-7ca5-4873-8f46-f1a9075fb606]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:32 user nova-compute[72954]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)
Sep 04 23:59:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 04 23:59:32 user nova-compute[72954]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 (non-flash)
Sep 04 23:59:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1181e39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[195345df-845d-4330-a4ee-2a3ef1d9cb9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b23bd1-bbdf-45db-aae6-f367c0cb6290]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c0e3d-f659-44c2-a3f7-962e6ae76288]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dcf12-3167-414e-b734-66a9b225590a]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1e618-7b90-4dd1-967d-8a32a461792e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1161510e-974e-436a-89f3-182681725163]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260]
Sep 04 23:59:32 user nova-compute[72954]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711, portal: 172.16.0.220,3260] successful.
Sep 04 23:59:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b86b9c-afe4-4f22-8c52-80388c6e4711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0fbdc3-1019-4126-b6f2-daf0dd4c15f4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] <== disconnect_volume: return (304ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 04 23:59:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:33 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'flavor' on Instance uuid 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 04 23:59:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b33c9a58-ece5-4a41-b687-72a8436d8e4d tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.993s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 04 23:59:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 04 23:59:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 04 23:59:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 04 23:59:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 04 23:59:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:59:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 04 23:59:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 04 23:59:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing instance network info cache due to event network-changed-5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] Acquiring lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] Acquired lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG nova.network.neutron [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Refreshing network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:22 user nova-compute[72954]: INFO nova.compute.manager [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Terminating instance
Sep 05 00:00:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:00:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-unplugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] No waiting events found dispatching network-vif-unplugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-48f6d21c-3759-4b1e-bce9-95e289bb78dc req-fe44ba0a-09f4-4253-8b3a-e67d3c6ad825 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-unplugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.network.neutron [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updated VIF entry in instance network info cache for port 5d3b440e-115a-4c23-9d19-f0b0da6d4d30. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.network.neutron [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [{"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-fdfdea95-dcb7-48c1-a2b0-a7ed758aa965 req-fdc053ec-5bbd-4636-8290-e96a0fcd7592 service nova] Releasing lock "refresh_cache-028ea2d5-63ec-449b-aa67-0d15a97cec0c" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Instance destroyed successfully.
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.objects.instance [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'resources' on Instance uuid 028ea2d5-63ec-449b-aa67-0d15a97cec0c {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1834395797',display_name='tempest-TestStampPattern-server-1834395797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1834395797',id=41,image_ref='f09fba18-a620-41f3-bc2b-ef7bfbe94b78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:57:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-bnqbgzx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b814f212-ae45-49c1-8101-2d86f3c970e0',image_min_disk='1',image_min_ram='0',image_owner_id='f4048c7fcec74d06aab1b693bed32639',image_owner_project_name='tempest-TestStampPattern-1760060686',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1760060686-project-member',image_user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:57:29Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=028ea2d5-63ec-449b-aa67-0d15a97cec0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "address": "fa:16:3e:c7:34:dd", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d3b440e-11", "ovs_interfaceid": "5d3b440e-115a-4c23-9d19-f0b0da6d4d30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG os_vif [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d3b440e-11, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:23 user nova-compute[72954]: INFO os_vif [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:34:dd,bridge_name='br-int',has_traffic_filtering=True,id=5d3b440e-115a-4c23-9d19-f0b0da6d4d30,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d3b440e-11')
Sep 05 00:00:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Deleting instance files /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c_del
Sep 05 00:00:23 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Deletion of /opt/stack/data/nova/instances/028ea2d5-63ec-449b-aa67-0d15a97cec0c_del complete
Sep 05 00:00:23 user nova-compute[72954]: INFO nova.compute.manager [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Took 0.88 seconds to destroy the instance on the hypervisor.
Sep 05 00:00:23 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:00:23 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:24 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Took 0.38 seconds to deallocate network for instance.
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:24 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Deleted allocations for instance 028ea2d5-63ec-449b-aa67-0d15a97cec0c
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-034a7beb-f679-45d9-be41-efa9a1a6f908 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.compute.manager [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing instance network info cache due to event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:24 user nova-compute[72954]: DEBUG nova.network.neutron [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:25 user nova-compute[72954]: INFO nova.compute.manager [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Shelve offloading
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated VIF entry in instance network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a99aaf83-2529-4081-82b9-21bd53552a44 req-feab5f00-f5d6-4811-89c0-38390c54f0fb service nova] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Acquiring lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Lock "028ea2d5-63ec-449b-aa67-0d15a97cec0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] No waiting events found dispatching network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:00:25 user nova-compute[72954]: WARNING nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received unexpected event network-vif-plugged-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 for instance with vm_state deleted and task_state None.
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Received event network-vif-deleted-5d3b440e-115a-4c23-9d19-f0b0da6d4d30 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:00:25 user nova-compute[72954]: WARNING nova.compute.manager [req-302cbc55-93f3-4074-a424-e43cc9dd1d67 req-816908dc-f745-474f-8975-3c0de5b38f4f service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state active and task_state shelving.
Sep 05 00:00:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance destroyed successfully.
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:25 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:00:26 user nova-compute[72954]: DEBUG nova.network.neutron [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance destroyed successfully.
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'resources' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA3U23sWkgh+8JH0UwhbFuiqxnqxSNXNBaiMRKNDkVghULcVEvTb/z6dH5JMYHN0lSUqERuPEKc5D/V6YJ7KV9XfBaddfab+J4uq4o/u7IlpTmVsPuVzQWOv/7I1OIjDA==',key_name='tempest-TestShelveInstance-962283649',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:58:53Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_vif [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb85bc9f7-65, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:27 user nova-compute[72954]: INFO os_vif [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65')
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:00:27 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f475a548-4656-42a0-b1d1-233914285e14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3588e2b-7ac1-4034-95b2-3168a4c8631b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:00:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:00:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1181540d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[45408911-7dc5-4c89-9a7f-59c59286a637]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e5a4e3-6fa4-4688-ba98-bf8afb1b214b]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9b692-a643-4ea8-9211-9529255ec4df]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8ddb6-2142-4f51-bcfe-2fe05007b7b5]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5006c3ad-e6aa-4304-9879-a4084e934e99]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704e923-23c5-408c-915d-8f38bd1943cb]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]
Sep 05 00:00:27 user nova-compute[72954]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.
Sep 05 00:00:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd17c63-fa10-4a0e-aab3-4f0c13a0b23e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== disconnect_volume: return (245ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:00:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deleting instance files /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b_del
Sep 05 00:00:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deletion of /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b_del complete
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:00:27 user nova-compute[72954]: WARNING nova.compute.manager [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state active and task_state shelving.
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing instance network info cache due to event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:00:28 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Deleted allocations for instance 04723ac0-4a7e-4365-ab31-0b7b7ba9959b
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated VIF entry in instance network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": null, "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c75a8b80-e664-4a68-b9d2-2225008f28bf req-2c361cc8-9346-4de7-b765-296da28d560b service nova] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.objects.instance [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'numa_topology' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.objects.base [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Object Instance<04723ac0-4a7e-4365-ab31-0b7b7ba9959b> lazy-loaded attributes: resources,numa_topology {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-d15fb67b-2151-4ef1-93ef-54ad048b575f tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.406s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:28 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:00:30 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.022441864013672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:00:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:37 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:38 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872023.711515, 028ea2d5-63ec-449b-aa67-0d15a97cec0c => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:00:38 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] VM Stopped (Lifecycle Event)
Sep 05 00:00:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2fce55f6-d26a-435b-bbed-85072ed9c456 None None] [instance: 028ea2d5-63ec-449b-aa67-0d15a97cec0c] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:00:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:00:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:00:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:00:40 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872025.9706514, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:00:40 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Stopped (Lifecycle Event)
Sep 05 00:00:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-84b39384-8d80-4ece-b77a-873ea139855f None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:00:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 05 00:00:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 05 00:00:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-changed-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Refreshing instance network info cache due to event network-changed-f7cd5981-72db-4481-bbfb-a68b7fadc4b3. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] Acquiring lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] Acquired lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Refreshing network info cache for port f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updated VIF entry in instance network info cache for port f7cd5981-72db-4481-bbfb-a68b7fadc4b3. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG nova.network.neutron [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:00:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-92b1efe2-423f-4a8d-8e34-dc801f0ea4d2 req-f9e79f51-eaa1-48a4-99b7-97066d4efe8e service nova] Releasing lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:00:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:00:47 user nova-compute[72954]: INFO nova.compute.manager [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Attaching volume 63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 to /dev/vdb
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.utils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b82d44-84ba-4088-8843-97eba9d450f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f99e07-b8a3-478a-8cb9-03164ae68b51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f625a7-5496-4d24-b23e-6cbd252209cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[17811c19-e633-411b-b190-4a043e9476b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:00:47 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:00:47 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4216ecd6-d3fa-475d-9a13-f8328a2decf4]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG os_brick.utils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:00:47 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating existing volume attachment record: 2247afd6-c1fe-4f5f-aecf-0fd4434e124b {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:00:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:00:58 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:00:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 05 00:01:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:02 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:01:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfoXtpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:01:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:01:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:01:08 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f910fb05-d444-4729-a32f-f68074580baa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:01:08 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89509c8-4279-445d-845f-b093d2c10ef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3] added
Sep 05 00:01:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1de266c-4b9a-4812-b1ab-bb6f79f8f85f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f635d10-6868-49cf-ab52-598c62ead199]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfoXtpbk {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfoXtpbk" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b4ca60-f0a1-4bef-b4e9-e3854c12dba8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfoXtpbk'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a2688d-00dd-40a5-88db-0bd0c2968474]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef53375-d0a2-4d7e-892a-0b2942f5869e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:01:08 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:01:08 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:01:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 05 00:01:08 user nova-compute[72954]: 
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d093a0-bb6f-4e7f-9650-804e7b4ac200]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260]
Sep 05 00:01:08 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260] successful.
Sep 05 00:01:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db61816-4007-4940-9f8f-e5ac4f0600db]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[359bc6d7-8139-4ec8-bc37-f377f1d70959]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:01:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:01:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:01:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc4bdc9-6cd1-4af5-bc07-5070631a64ff]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:01:09 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfoXtpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23534323139633539', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534323139633539', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] attach device xml: <disk type="block" device="disk">
Sep 05 00:01:10 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:01:10 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:01:10 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:01:10 user nova-compute[72954]:   <serial>63894f07-2a4a-4d55-9bd9-c0b0ec4043d3</serial>
Sep 05 00:01:10 user nova-compute[72954]: </disk>
Sep 05 00:01:10 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:c1:18:7f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:01:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8078b91d-3e18-4e18-9e9b-a68109d5a323 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.209s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:01:13 user nova-compute[72954]: INFO nova.compute.claims [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Claim successful on node user
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:01:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.policy [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61e815f67e4f509e9e33e97201759c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f019505deedc4dcba8ef93923b81c192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:01:13 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Creating image(s)
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "/opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:13 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk 1073741824" returned: 0 in 0.063s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Successfully created port: 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.170s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Cannot resize image /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Ensure instance console log exists: /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Successfully updated port: 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquired lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:01:14 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-changed-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.compute.manager [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Refreshing instance network info cache due to event network-changed-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] Acquiring lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.neutron [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updating instance_info_cache with network_info: [{"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Releasing lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Instance network_info: |[{"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] Acquired lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Refreshing network info cache for port 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Start _get_guest_xml network_info=[{"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:01:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:01:15 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-92319914',display_name='tempest-AttachVolumeNegativeTest-server-92319914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-92319914',id=44,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDhygbcIzVr4MFDsEY85mfkqZrBG2+BUtn6xUL13J9N8xeDxnvOUwlOB8a9Yl2Pn6LO9qoi1aEpYNoxKdZZdn6xTy2XLL/LUnZL3Gn65B8moyiSr0HQjAMYZ0QUli2gWw==',key_name='tempest-keypair-1737961329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-bi93cifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4be91b96-be84-4e7d-a656-e1bd058fbe38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.objects.instance [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'pci_devices' on Instance uuid 4be91b96-be84-4e7d-a656-e1bd058fbe38 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:01:15 user nova-compute[72954]:   <uuid>4be91b96-be84-4e7d-a656-e1bd058fbe38</uuid>
Sep 05 00:01:15 user nova-compute[72954]:   <name>instance-0000002c</name>
Sep 05 00:01:15 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:01:15 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:01:15 user nova-compute[72954]:   <metadata>
Sep 05 00:01:15 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:01:15 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeNegativeTest-server-92319914</nova:name>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:01:15</nova:creationTime>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:01:15 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:01:15 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:owner>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:user uuid="ff61e815f67e4f509e9e33e97201759c">tempest-AttachVolumeNegativeTest-2127434441-project-member</nova:user>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:project uuid="f019505deedc4dcba8ef93923b81c192">tempest-AttachVolumeNegativeTest-2127434441</nova:project>
Sep 05 00:01:15 user nova-compute[72954]:       </nova:owner>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 05 00:01:15 user nova-compute[72954]:       <nova:ports>
Sep 05 00:01:15 user nova-compute[72954]:         <nova:port uuid="3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec">
Sep 05 00:01:15 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 05 00:01:15 user nova-compute[72954]:         </nova:port>
Sep 05 00:01:15 user nova-compute[72954]:       </nova:ports>
Sep 05 00:01:15 user nova-compute[72954]:     </nova:instance>
Sep 05 00:01:15 user nova-compute[72954]:   </metadata>
Sep 05 00:01:15 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:01:15 user nova-compute[72954]:     <system>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="serial">4be91b96-be84-4e7d-a656-e1bd058fbe38</entry>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="uuid">4be91b96-be84-4e7d-a656-e1bd058fbe38</entry>
Sep 05 00:01:15 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:01:15 user nova-compute[72954]:     </system>
Sep 05 00:01:15 user nova-compute[72954]:   </sysinfo>
Sep 05 00:01:15 user nova-compute[72954]:   <os>
Sep 05 00:01:15 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:01:15 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:01:15 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:01:15 user nova-compute[72954]:   </os>
Sep 05 00:01:15 user nova-compute[72954]:   <features>
Sep 05 00:01:15 user nova-compute[72954]:     <acpi/>
Sep 05 00:01:15 user nova-compute[72954]:     <apic/>
Sep 05 00:01:15 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:01:15 user nova-compute[72954]:   </features>
Sep 05 00:01:15 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:01:15 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:01:15 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:01:15 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:01:15 user nova-compute[72954]:   </clock>
Sep 05 00:01:15 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:01:15 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:01:15 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:01:15 user nova-compute[72954]:   </cpu>
Sep 05 00:01:15 user nova-compute[72954]:   <devices>
Sep 05 00:01:15 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 05 00:01:15 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 05 00:01:15 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk"/>
Sep 05 00:01:15 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:01:15 user nova-compute[72954]:     </disk>
Sep 05 00:01:15 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:01:15 user nova-compute[72954]:       <mac address="fa:16:3e:bc:bf:ca"/>
Sep 05 00:01:15 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:01:15 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:01:15 user nova-compute[72954]:       <target dev="tap3e3f46d3-db"/>
Sep 05 00:01:15 user nova-compute[72954]:     </interface>
Sep 05 00:01:15 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:01:15 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/console.log" append="off"/>
Sep 05 00:01:15 user nova-compute[72954]:     </serial>
Sep 05 00:01:15 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:01:15 user nova-compute[72954]:     <video>
Sep 05 00:01:15 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:01:15 user nova-compute[72954]:     </video>
Sep 05 00:01:15 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:01:15 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:01:15 user nova-compute[72954]:     </rng>
Sep 05 00:01:15 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:01:15 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:01:15 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:01:15 user nova-compute[72954]:     </memballoon>
Sep 05 00:01:15 user nova-compute[72954]:   </devices>
Sep 05 00:01:15 user nova-compute[72954]: </domain>
Sep 05 00:01:15 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-92319914',display_name='tempest-AttachVolumeNegativeTest-server-92319914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-92319914',id=44,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDhygbcIzVr4MFDsEY85mfkqZrBG2+BUtn6xUL13J9N8xeDxnvOUwlOB8a9Yl2Pn6LO9qoi1aEpYNoxKdZZdn6xTy2XLL/LUnZL3Gn65B8moyiSr0HQjAMYZ0QUli2gWw==',key_name='tempest-keypair-1737961329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-bi93cifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4be91b96-be84-4e7d-a656-e1bd058fbe38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG os_vif [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e3f46d3-db, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e3f46d3-db, col_values=(('external_ids', {'iface-id': '3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:bf:ca', 'vm-uuid': '4be91b96-be84-4e7d-a656-e1bd058fbe38'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:15 user nova-compute[72954]: INFO os_vif [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db')
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:bc:bf:ca, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updated VIF entry in instance network info cache for port 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG nova.network.neutron [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updating instance_info_cache with network_info: [{"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:01:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-14a9536c-259b-495a-a9ab-6740f3286c47 req-6d6fc47f-3d7a-4a3b-8229-9ded0a8851cc service nova] Releasing lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] No waiting events found dispatching network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:01:17 user nova-compute[72954]: WARNING nova.compute.manager [req-da6eb476-3256-4002-a39f-da5d74cdfcfa req-1d4d9eee-5062-4353-b0c2-254b746679f9 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received unexpected event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec for instance with vm_state building and task_state spawning.
Sep 05 00:01:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872078.794175, 4be91b96-be84-4e7d-a656-e1bd058fbe38 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] VM Resumed (Lifecycle Event)
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Instance spawned successfully.
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872078.7950816, 4be91b96-be84-4e7d-a656-e1bd058fbe38 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] VM Started (Lifecycle Event)
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Took 5.08 seconds to spawn the instance on the hypervisor.
Sep 05 00:01:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:01:18 user nova-compute[72954]: INFO nova.compute.manager [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Took 5.77 seconds to build instance.
Sep 05 00:01:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-80150a6e-dfa7-424f-a823-e11f19e134e5 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.872s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] No waiting events found dispatching network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:01:19 user nova-compute[72954]: WARNING nova.compute.manager [req-577a3d1c-fc56-4a1f-8b5a-13e3d627d2ae req-aef545f1-63ea-41a8-9cde-2c8ae7e5ce8f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received unexpected event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec for instance with vm_state active and task_state None.
Sep 05 00:01:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:29 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:30 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing instance network info cache due to event network-changed-f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] Acquiring lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] Acquired lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.network.neutron [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Refreshing network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:01:31 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:01:31 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=25.117538452148438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:31 user nova-compute[72954]: INFO nova.compute.manager [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Terminating instance
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance b814f212-ae45-49c1-8101-2d86f3c970e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4be91b96-be84-4e7d-a656-e1bd058fbe38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-unplugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] No waiting events found dispatching network-vif-unplugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:01:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-cde9a735-a3fe-4a41-8bdc-5e5a9a02c350 req-19aded19-25ef-4a31-8e31-463a398eff4c service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-unplugged-f0d8897e-be82-457e-b44c-3c477bd9e809 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updated VIF entry in instance network info cache for port f0d8897e-be82-457e-b44c-3c477bd9e809. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [{"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-13a55540-f417-4c16-987d-4c3fb6c0db14 req-b9cdb94c-78a8-44ed-9491-0c4c0ebdf7e0 service nova] Releasing lock "refresh_cache-b814f212-ae45-49c1-8101-2d86f3c970e0" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Instance destroyed successfully.
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lazy-loading 'resources' on Instance uuid b814f212-ae45-49c1-8101-2d86f3c970e0 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1145103175',display_name='tempest-TestStampPattern-server-1145103175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1145103175',id=39,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErgXroeRlyO9RhYCXKXOZOzHCsY8v1X9E1s6tiMhQBSGDL+aBJPfQnVqL1wZ4hdZvv27hPI9Jws1LRPMcMZ0PE9avydIDUuq4yVanie5bqONWh1WBM7wJKV3mbmmCmS3g==',key_name='tempest-TestStampPattern-1620387252',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4048c7fcec74d06aab1b693bed32639',ramdisk_id='',reservation_id='r-r3rdk9bq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1760060686',owner_user_name='tempest-TestStampPattern-1760060686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:57:18Z,user_data=None,user_id='a6a96b3e1f6f4599a8bb0920b6f7b2d4',uuid=b814f212-ae45-49c1-8101-2d86f3c970e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converting VIF {"id": "f0d8897e-be82-457e-b44c-3c477bd9e809", "address": "fa:16:3e:b9:e1:bf", "network": {"id": "017a6690-d3b8-4923-ac50-433ae817d7c4", "bridge": "br-int", "label": "tempest-TestStampPattern-377086429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4048c7fcec74d06aab1b693bed32639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d8897e-be", "ovs_interfaceid": "f0d8897e-be82-457e-b44c-3c477bd9e809", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG os_vif [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0d8897e-be, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:32 user nova-compute[72954]: INFO os_vif [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:e1:bf,bridge_name='br-int',has_traffic_filtering=True,id=f0d8897e-be82-457e-b44c-3c477bd9e809,network=Network(017a6690-d3b8-4923-ac50-433ae817d7c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d8897e-be')
Sep 05 00:01:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Deleting instance files /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0_del
Sep 05 00:01:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Deletion of /opt/stack/data/nova/instances/b814f212-ae45-49c1-8101-2d86f3c970e0_del complete
Sep 05 00:01:32 user nova-compute[72954]: INFO nova.compute.manager [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Took 0.89 seconds to destroy the instance on the hypervisor.
Sep 05 00:01:32 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:01:32 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:01:32 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Took 0.43 seconds to deallocate network for instance.
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:33 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Deleted allocations for instance b814f212-ae45-49c1-8101-2d86f3c970e0
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-94d4b6b5-7fed-460a-999e-95ed5c9052f9 tempest-TestStampPattern-1760060686 tempest-TestStampPattern-1760060686-project-member] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-9f7c881e-2968-4b08-acf0-8218c1640a54 req-01a6658f-0d52-459d-8d27-187d5f4398ed service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-deleted-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] Acquiring lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] Lock "b814f212-ae45-49c1-8101-2d86f3c970e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:01:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] No waiting events found dispatching network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:01:33 user nova-compute[72954]: WARNING nova.compute.manager [req-43bb3431-5fca-41b1-9d01-9aeb83986351 req-8a1b36e5-ef39-417f-879c-13b9b70ba25d service nova] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Received unexpected event network-vif-plugged-f0d8897e-be82-457e-b44c-3c477bd9e809 for instance with vm_state deleted and task_state None.
Sep 05 00:01:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:01:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:01:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:01:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:01:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:01:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:47 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872092.395871, b814f212-ae45-49c1-8101-2d86f3c970e0 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:01:47 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] VM Stopped (Lifecycle Event)
Sep 05 00:01:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70ef8cd2-ac98-4d9e-81a2-05d5af6d764f None None] [instance: b814f212-ae45-49c1-8101-2d86f3c970e0] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:01:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:01:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:02:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:17 user nova-compute[72954]: INFO nova.compute.manager [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Unshelving
Sep 05 00:02:17 user nova-compute[72954]: INFO nova.virt.block_device [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Booting with volume f880bdba-49af-4bf8-ad54-fec4c0f2079c at /dev/vda
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b162e-5435-48eb-a344-43188e8252be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3ad14-0922-43fc-b8d3-881efd7d0039]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05d386-ee68-4510-b836-0360dc435941]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c6dc80-5454-4194-bf35-a3d0c42955bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:02:17 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:02:17 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e762e78b-03ec-4899-a256-37fd43b8bbe0]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG os_brick.utils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating existing volume attachment record: b0810323-80f5-4023-acbc-496187087ef9 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:02:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'pci_requests' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'numa_topology' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:02:30 user nova-compute[72954]: INFO nova.compute.claims [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Claim successful on node user
Sep 05 00:02:30 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:02:30 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.125s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:02:31 user nova-compute[72954]: INFO nova.network.neutron [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating port b85bc9f7-653f-4b60-b649-3dcb99440e77 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing instance network info cache due to event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:02:31 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:02:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.116382598876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4be91b96-be84-4e7d-a656-e1bd058fbe38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (1011a3ca-a5c6-4712-8224-4088238dab96): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:02:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Creating image(s)
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Ensure instance console log exists: /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start _get_guest_xml network_info=[{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04723ac0-4a7e-4365-ab31-0b7b7ba9959b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f880bdba-49af-4bf8-ad54-fec4c0f2079c', 'serial': 'f880bdba-49af-4bf8-ad54-fec4c0f2079c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'b0810323-80f5-4023-acbc-496187087ef9', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.network.neutron [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:02:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.objects.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Object Instance<04723ac0-4a7e-4365-ab31-0b7b7ba9959b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:02:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:02:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:02:32 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65be344-4984-4f18-9ec2-53fdb46f4ca1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:02:32 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd6e8e-b553-4e1c-b5f9-c463021e7ea4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c] added
Sep 05 00:02:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5032bc7-d450-44cc-8af6-822a8862c5d5]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a1b48-1c24-4968-abcb-211ddeceb07b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiIolWeP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HiIolWeP" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8af01b-b727-46fb-af94-50a8a96ee768]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HiIolWeP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08e1bbb-4afb-454a-b2be-723c161fb8d7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d13720-249c-4ae1-8ecf-3b962a2376c6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:02:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:02:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:02:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b41456-7ebe-408f-bccc-442fb2d5d7cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]
Sep 05 00:02:33 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.
Sep 05 00:02:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b1fae-a0d7-47a7-904a-7f8403717280]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929bb42-a4cd-439f-b705-1088568c7c93]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:02:33 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:02:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:02:33 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:02:33 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c4ec3-d2d7-4e95-a4e4-2c75452b503a]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated VIF entry in instance network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f25a1b0f-22db-4b9c-a11a-25cddcc40d2c req-5870bd49-a98c-4e30-824a-9563dfd06e7e service nova] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:02:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23438613562633061', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438613562633061', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-962283649',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:02:17Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'pci_devices' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.objects.base [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Object Instance<04723ac0-4a7e-4365-ab31-0b7b7ba9959b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=72954) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:02:34 user nova-compute[72954]:   <uuid>04723ac0-4a7e-4365-ab31-0b7b7ba9959b</uuid>
Sep 05 00:02:34 user nova-compute[72954]:   <name>instance-0000002a</name>
Sep 05 00:02:34 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:02:34 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:02:34 user nova-compute[72954]:   <metadata>
Sep 05 00:02:34 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:02:34 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:02:34 user nova-compute[72954]:       <nova:name>tempest-TestShelveInstance-server-1949779981</nova:name>
Sep 05 00:02:34 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:02:32</nova:creationTime>
Sep 05 00:02:34 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:02:34 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:02:34 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:02:34 user nova-compute[72954]:       <nova:owner>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:user uuid="c4b4395e34e548a0b2bf572e5217d070">tempest-TestShelveInstance-146984119-project-member</nova:user>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:project uuid="e9120760d601419b93f6d9b8ec092193">tempest-TestShelveInstance-146984119</nova:project>
Sep 05 00:02:34 user nova-compute[72954]:       </nova:owner>
Sep 05 00:02:34 user nova-compute[72954]:       <nova:ports>
Sep 05 00:02:34 user nova-compute[72954]:         <nova:port uuid="b85bc9f7-653f-4b60-b649-3dcb99440e77">
Sep 05 00:02:34 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Sep 05 00:02:34 user nova-compute[72954]:         </nova:port>
Sep 05 00:02:34 user nova-compute[72954]:       </nova:ports>
Sep 05 00:02:34 user nova-compute[72954]:     </nova:instance>
Sep 05 00:02:34 user nova-compute[72954]:   </metadata>
Sep 05 00:02:34 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:02:34 user nova-compute[72954]:     <system>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="serial">04723ac0-4a7e-4365-ab31-0b7b7ba9959b</entry>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="uuid">04723ac0-4a7e-4365-ab31-0b7b7ba9959b</entry>
Sep 05 00:02:34 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:02:34 user nova-compute[72954]:     </system>
Sep 05 00:02:34 user nova-compute[72954]:   </sysinfo>
Sep 05 00:02:34 user nova-compute[72954]:   <os>
Sep 05 00:02:34 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:02:34 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:02:34 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:02:34 user nova-compute[72954]:   </os>
Sep 05 00:02:34 user nova-compute[72954]:   <features>
Sep 05 00:02:34 user nova-compute[72954]:     <acpi/>
Sep 05 00:02:34 user nova-compute[72954]:     <apic/>
Sep 05 00:02:34 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:02:34 user nova-compute[72954]:   </features>
Sep 05 00:02:34 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:02:34 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:02:34 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:02:34 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:02:34 user nova-compute[72954]:   </clock>
Sep 05 00:02:34 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:02:34 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:02:34 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:02:34 user nova-compute[72954]:   </cpu>
Sep 05 00:02:34 user nova-compute[72954]:   <devices>
Sep 05 00:02:34 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:02:34 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:02:34 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 05 00:02:34 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:02:34 user nova-compute[72954]:       <serial>f880bdba-49af-4bf8-ad54-fec4c0f2079c</serial>
Sep 05 00:02:34 user nova-compute[72954]:     </disk>
Sep 05 00:02:34 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:02:34 user nova-compute[72954]:       <mac address="fa:16:3e:11:87:8f"/>
Sep 05 00:02:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:02:34 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:02:34 user nova-compute[72954]:       <target dev="tapb85bc9f7-65"/>
Sep 05 00:02:34 user nova-compute[72954]:     </interface>
Sep 05 00:02:34 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:02:34 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b/console.log" append="off"/>
Sep 05 00:02:34 user nova-compute[72954]:     </serial>
Sep 05 00:02:34 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:02:34 user nova-compute[72954]:     <video>
Sep 05 00:02:34 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:02:34 user nova-compute[72954]:     </video>
Sep 05 00:02:34 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:02:34 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:02:34 user nova-compute[72954]:     </rng>
Sep 05 00:02:34 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:02:34 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:02:34 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:02:34 user nova-compute[72954]:     </memballoon>
Sep 05 00:02:34 user nova-compute[72954]:   </devices>
Sep 05 00:02:34 user nova-compute[72954]: </domain>
Sep 05 00:02:34 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-962283649',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:02:17Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG os_vif [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb85bc9f7-65, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb85bc9f7-65, col_values=(('external_ids', {'iface-id': 'b85bc9f7-653f-4b60-b649-3dcb99440e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:87:8f', 'vm-uuid': '04723ac0-4a7e-4365-ab31-0b7b7ba9959b'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:34 user nova-compute[72954]: INFO os_vif [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65')
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:02:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] No VIF found with MAC fa:16:3e:11:87:8f, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:02:35 user nova-compute[72954]: WARNING nova.compute.manager [req-a5ff0c32-830d-47b4-a9dc-2ea5b37efd23 req-69c49a02-e717-4e04-8618-969ff28a7ea3 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state shelved_offloaded and task_state spawning.
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872157.6289227, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:02:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Resumed (Lifecycle Event)
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:02:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance spawned successfully.
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:02:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872157.6308336, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:02:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Started (Lifecycle Event)
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7f3b0e78-3ceb-4662-a39d-f74808a27622 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.633s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:02:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:02:37 user nova-compute[72954]: WARNING nova.compute.manager [req-71714e87-c421-4847-bf46-00f2bb8f5a9b req-416fce92-9465-4fa3-a73c-25f04e0ee44a service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state active and task_state None.
Sep 05 00:02:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:38 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:02:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:02:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:02:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:02:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:02:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:02:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:02:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-changed-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Refreshing instance network info cache due to event network-changed-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] Acquiring lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] Acquired lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.network.neutron [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Refreshing network info cache for port 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.network.neutron [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updated VIF entry in instance network info cache for port 3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.network.neutron [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updating instance_info_cache with network_info: [{"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:04 user nova-compute[72954]: INFO nova.compute.manager [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Terminating instance
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-712de0b5-3a7c-49c0-9c08-6143b9084760 req-eb4c4248-e80f-4807-ab38-a0885136e380 service nova] Releasing lock "refresh_cache-4be91b96-be84-4e7d-a656-e1bd058fbe38" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-unplugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] No waiting events found dispatching network-vif-unplugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG nova.compute.manager [req-8643bd89-c225-433a-81f7-aec1590f4f48 req-ea1003b1-5196-4f8c-aa14-6f980dffd06f service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-unplugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Instance destroyed successfully.
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'resources' on Instance uuid 4be91b96-be84-4e7d-a656-e1bd058fbe38 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-92319914',display_name='tempest-AttachVolumeNegativeTest-server-92319914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-92319914',id=44,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDhygbcIzVr4MFDsEY85mfkqZrBG2+BUtn6xUL13J9N8xeDxnvOUwlOB8a9Yl2Pn6LO9qoi1aEpYNoxKdZZdn6xTy2XLL/LUnZL3Gn65B8moyiSr0HQjAMYZ0QUli2gWw==',key_name='tempest-keypair-1737961329',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-bi93cifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4be91b96-be84-4e7d-a656-e1bd058fbe38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "address": "fa:16:3e:bc:bf:ca", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3f46d3-db", "ovs_interfaceid": "3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG os_vif [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e3f46d3-db, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:03:05 user nova-compute[72954]: INFO os_vif [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:bf:ca,bridge_name='br-int',has_traffic_filtering=True,id=3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3f46d3-db')
Sep 05 00:03:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Deleting instance files /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38_del
Sep 05 00:03:05 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Deletion of /opt/stack/data/nova/instances/4be91b96-be84-4e7d-a656-e1bd058fbe38_del complete
Sep 05 00:03:05 user nova-compute[72954]: INFO nova.compute.manager [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Took 0.85 seconds to destroy the instance on the hypervisor.
Sep 05 00:03:05 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:03:05 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:03:06 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Took 1.03 seconds to deallocate network for instance.
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-65f03fb6-dd21-47a6-b3e4-7f858cf4c312 req-30669762-be06-4d77-81cf-bc928fde71fc service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-deleted-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:06 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Deleted allocations for instance 4be91b96-be84-4e7d-a656-e1bd058fbe38
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b386334c-5f5f-4130-9ce5-2cfeb574b7b2 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] Acquiring lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] Lock "4be91b96-be84-4e7d-a656-e1bd058fbe38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] No waiting events found dispatching network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:03:06 user nova-compute[72954]: WARNING nova.compute.manager [req-105886aa-9fcf-4c4b-bdc1-11eb9498f947 req-adba0096-bed0-400d-9935-1cc7fb7455c2 service nova] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Received unexpected event network-vif-plugged-3e3f46d3-dbea-4fee-a9e1-3e65cfff36ec for instance with vm_state deleted and task_state None.
Sep 05 00:03:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:15 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:03:15 user nova-compute[72954]: INFO nova.compute.claims [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Claim successful on node user
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:03:16 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.policy [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:03:16 user nova-compute[72954]: INFO nova.virt.block_device [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Booting with volume snapshot cea16211-31f0-47e0-85ac-f4125f6b28ce at /dev/vda
Sep 05 00:03:16 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Successfully created port: f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Successfully updated port: f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-changed-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.compute.manager [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Refreshing instance network info cache due to event network-changed-f463327f-1f91-4e54-8d5c-5d0242f0823a. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] Acquiring lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Updating instance_info_cache with network_info: [{"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Instance network_info: |[{"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] Acquired lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:03:17 user nova-compute[72954]: DEBUG nova.network.neutron [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Refreshing network info cache for port f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:03:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Updated VIF entry in instance network info cache for port f463327f-1f91-4e54-8d5c-5d0242f0823a. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:03:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Updating instance_info_cache with network_info: [{"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:03:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-ce069d67-afeb-4173-9320-1f359c3a612d req-c21238c7-7235-4f2d-881c-6b467d7a9068 service nova] Releasing lock "refresh_cache-f51548c2-5bde-49d5-8635-90abcb11cdd4" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:03:20 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872185.209392, 4be91b96-be84-4e7d-a656-e1bd058fbe38 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:03:20 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] VM Stopped (Lifecycle Event)
Sep 05 00:03:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-761f05b4-02d7-44f9-b1f4-b4dd0acfe720 None None] [instance: 4be91b96-be84-4e7d-a656-e1bd058fbe38] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:03:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG os_brick.utils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[afabbb3c-b699-460c-a884-9443c02ede02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c15a96c-5228-4dd3-8667-c72cd0399e0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffb4a71-f1c7-4e00-b3a1-3392d31fc4ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767146f-d3d5-4958-a5e2-53984f8dd6bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:03:22 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:03:22 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d778d0aa-3844-4594-a618-33c78016ec2b]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG os_brick.utils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:03:22 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Updating existing volume attachment record: 3e2d1927-3ccd-4f54-b493-14893acb8c4f {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:03:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:03:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:03:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8568MB free_disk=25.140777587890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 04723ac0-4a7e-4365-ab31-0b7b7ba9959b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f51548c2-5bde-49d5-8635-90abcb11cdd4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:03:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:03:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:03:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:03:35 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Creating image(s)
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Ensure instance console log exists: /opt/stack/data/nova/instances/f51548c2-5bde-49d5-8635-90abcb11cdd4/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Start _get_guest_xml network_info=[{"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVwBQfdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f51548c2-5bde-49d5-8635-90abcb11cdd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7f31c69-a9d3-4905-922d-1a52cfb45c09', 'serial': 'e7f31c69-a9d3-4905-922d-1a52cfb45c09'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '3e2d1927-3ccd-4f54-b493-14893acb8c4f', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:03:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:03:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVwBQfdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:03:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:03:35 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:03:35 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fbbab7-b203-40dd-803a-a849a201826d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:03:35 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677b483-5bf1-446d-8573-5a8901e173cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09] added
Sep 05 00:03:35 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[62545bb4-4bbf-4f56-89da-44482ee45d7b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13c623-88a3-495b-908e-245a4d88a10f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVwBQfdj {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OVwBQfdj" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768aa33-4dae-4d24-a0e7-180f010422c6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OVwBQfdj'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a934a3b-31f1-4cfe-8be6-1619b45cb082]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b2d78-740e-455b-b303-334e997d3eba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89630fb-55d8-4f53-a409-b1445e7393ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260]
Sep 05 00:03:36 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260] successful.
Sep 05 00:03:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2cf1c9-f2e8-473f-b133-4c88c03338a1]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[564829b5-8f26-43a2-9a2a-261d91cb1e5e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:36 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:03:36 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[987c2581-f151-4658-b7da-121dae6b7f0b]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVwBQfdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:03:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23761353836666462', 'path': '/dev/sdd'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761353836666462', 'path': '/dev/sdd'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831204670',display_name='tempest-TestVolumeBootPattern-server-831204670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-831204670',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-h0bngyyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:03:16Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f51548c2-5bde-49d5-8635-90abcb11cdd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid f51548c2-5bde-49d5-8635-90abcb11cdd4 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:03:37 user nova-compute[72954]:   <uuid>f51548c2-5bde-49d5-8635-90abcb11cdd4</uuid>
Sep 05 00:03:37 user nova-compute[72954]:   <name>instance-0000002d</name>
Sep 05 00:03:37 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:03:37 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:03:37 user nova-compute[72954]:   <metadata>
Sep 05 00:03:37 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:03:37 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:03:37 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-server-831204670</nova:name>
Sep 05 00:03:37 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:03:35</nova:creationTime>
Sep 05 00:03:37 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:03:37 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:03:37 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:03:37 user nova-compute[72954]:       <nova:owner>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:03:37 user nova-compute[72954]:       </nova:owner>
Sep 05 00:03:37 user nova-compute[72954]:       <nova:ports>
Sep 05 00:03:37 user nova-compute[72954]:         <nova:port uuid="f463327f-1f91-4e54-8d5c-5d0242f0823a">
Sep 05 00:03:37 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Sep 05 00:03:37 user nova-compute[72954]:         </nova:port>
Sep 05 00:03:37 user nova-compute[72954]:       </nova:ports>
Sep 05 00:03:37 user nova-compute[72954]:     </nova:instance>
Sep 05 00:03:37 user nova-compute[72954]:   </metadata>
Sep 05 00:03:37 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:03:37 user nova-compute[72954]:     <system>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="serial">f51548c2-5bde-49d5-8635-90abcb11cdd4</entry>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="uuid">f51548c2-5bde-49d5-8635-90abcb11cdd4</entry>
Sep 05 00:03:37 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:03:37 user nova-compute[72954]:     </system>
Sep 05 00:03:37 user nova-compute[72954]:   </sysinfo>
Sep 05 00:03:37 user nova-compute[72954]:   <os>
Sep 05 00:03:37 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:03:37 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:03:37 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:03:37 user nova-compute[72954]:   </os>
Sep 05 00:03:37 user nova-compute[72954]:   <features>
Sep 05 00:03:37 user nova-compute[72954]:     <acpi/>
Sep 05 00:03:37 user nova-compute[72954]:     <apic/>
Sep 05 00:03:37 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:03:37 user nova-compute[72954]:   </features>
Sep 05 00:03:37 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:03:37 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:03:37 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:03:37 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:03:37 user nova-compute[72954]:   </clock>
Sep 05 00:03:37 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:03:37 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:03:37 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:03:37 user nova-compute[72954]:   </cpu>
Sep 05 00:03:37 user nova-compute[72954]:   <devices>
Sep 05 00:03:37 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:03:37 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:03:37 user nova-compute[72954]:       <source dev="/dev/sdd"/>
Sep 05 00:03:37 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:03:37 user nova-compute[72954]:       <serial>e7f31c69-a9d3-4905-922d-1a52cfb45c09</serial>
Sep 05 00:03:37 user nova-compute[72954]:     </disk>
Sep 05 00:03:37 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:03:37 user nova-compute[72954]:       <mac address="fa:16:3e:30:2b:d1"/>
Sep 05 00:03:37 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:03:37 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:03:37 user nova-compute[72954]:       <target dev="tapf463327f-1f"/>
Sep 05 00:03:37 user nova-compute[72954]:     </interface>
Sep 05 00:03:37 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:03:37 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/f51548c2-5bde-49d5-8635-90abcb11cdd4/console.log" append="off"/>
Sep 05 00:03:37 user nova-compute[72954]:     </serial>
Sep 05 00:03:37 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:03:37 user nova-compute[72954]:     <video>
Sep 05 00:03:37 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:03:37 user nova-compute[72954]:     </video>
Sep 05 00:03:37 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:03:37 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:03:37 user nova-compute[72954]:     </rng>
Sep 05 00:03:37 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:03:37 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:03:37 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:03:37 user nova-compute[72954]:     </memballoon>
Sep 05 00:03:37 user nova-compute[72954]:   </devices>
Sep 05 00:03:37 user nova-compute[72954]: </domain>
Sep 05 00:03:37 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831204670',display_name='tempest-TestVolumeBootPattern-server-831204670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-831204670',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-h0bngyyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:03:16Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f51548c2-5bde-49d5-8635-90abcb11cdd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG os_vif [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf463327f-1f, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf463327f-1f, col_values=(('external_ids', {'iface-id': 'f463327f-1f91-4e54-8d5c-5d0242f0823a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:2b:d1', 'vm-uuid': 'f51548c2-5bde-49d5-8635-90abcb11cdd4'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:37 user nova-compute[72954]: INFO os_vif [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f')
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:30:2b:d1, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:03:37 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG nova.compute.manager [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] No waiting events found dispatching network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:03:38 user nova-compute[72954]: WARNING nova.compute.manager [req-10140cb2-09fe-4803-9e67-f352ff326688 req-39910ac7-d334-422d-8a1c-ac2cd3e3c60f service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received unexpected event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a for instance with vm_state building and task_state spawning.
Sep 05 00:03:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872220.6343274, f51548c2-5bde-49d5-8635-90abcb11cdd4 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] VM Resumed (Lifecycle Event)
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Instance spawned successfully.
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872220.635892, f51548c2-5bde-49d5-8635-90abcb11cdd4 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] VM Started (Lifecycle Event)
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Took 4.85 seconds to spawn the instance on the hypervisor.
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:03:40 user nova-compute[72954]: INFO nova.compute.manager [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Took 24.99 seconds to build instance.
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] No waiting events found dispatching network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:03:40 user nova-compute[72954]: WARNING nova.compute.manager [req-1d3d7c5f-882e-4465-a633-d93a3dde6327 req-652fd0f4-20cc-4e1a-b990-cc588baa2f53 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received unexpected event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a for instance with vm_state active and task_state None.
Sep 05 00:03:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-afe25d7b-7d8c-47ab-8131-e3bd6eba19af tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.099s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:03:40 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:03:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:03:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:03:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:03:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:42 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [{"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:03:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:03:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:03:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:03:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:03:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:03:55 user nova-compute[72954]: INFO nova.compute.manager [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Detaching volume 63894f07-2a4a-4d55-9bd9-c0b0ec4043d3
Sep 05 00:03:55 user nova-compute[72954]: INFO nova.virt.block_device [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Attempting to driver detach volume 63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 from mountpoint /dev/vdb
Sep 05 00:03:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Attempting to detach device vdb from instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 05 00:03:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:03:55 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:03:55 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:03:55 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:03:55 user nova-compute[72954]:   <serial>63894f07-2a4a-4d55-9bd9-c0b0ec4043d3</serial>
Sep 05 00:03:55 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:03:55 user nova-compute[72954]: </disk>
Sep 05 00:03:55 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:03:55 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 from the persistent domain config.
Sep 05 00:03:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 05 00:03:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:03:55 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:03:55 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:03:55 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:03:55 user nova-compute[72954]:   <serial>63894f07-2a4a-4d55-9bd9-c0b0ec4043d3</serial>
Sep 05 00:03:55 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:03:55 user nova-compute[72954]: </disk>
Sep 05 00:03:55 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693872236.2057383, 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 05 00:03:56 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 from the live domain config.
Sep 05 00:03:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfoXtpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:03:56 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc64da-36d4-4945-9377-1d6ed1cd78e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf339d-e961-4c74-852c-ac15e7a99776]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:56 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:56 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:03:56 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 (non-flash)
Sep 05 00:03:56 user nova-compute[72954]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:03:56 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:03:56 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1183d0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d298735-c041-4205-9747-49f1af248595]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[515f0339-95c9-4d64-a59e-a405007d89d4]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e8f31-f9c6-443c-94ef-2d8bdeab6671]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[11897178-cae2-4bec-9494-ece2c471d46d]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9d15a-1f86-4bd2-9a64-1e885d44627c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f377ae8a-3fbd-4c2b-a693-6d5a24af9fa2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260]
Sep 05 00:03:56 user nova-compute[72954]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3, portal: 172.16.0.220,3260] successful.
Sep 05 00:03:56 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63894f07-2a4a-4d55-9bd9-c0b0ec4043d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260eec7-7fa6-40dc-96a6-b0f1075b4bdb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== disconnect_volume: return (284ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:03:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:03:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:57 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:03:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:03:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8b615094-4c1e-485b-90f7-d9259c6b0313 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG nova.compute.manager [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing instance network info cache due to event network-changed-b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] Acquiring lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] Acquired lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG nova.network.neutron [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Refreshing network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:07 user nova-compute[72954]: INFO nova.compute.manager [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Terminating instance
Sep 05 00:04:07 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.network.neutron [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updated VIF entry in instance network info cache for port b85bc9f7-653f-4b60-b649-3dcb99440e77. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.network.neutron [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [{"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-83033ef3-71f4-41e7-aadb-a10371f86fa6 req-56255bc9-4d1d-4bd9-8ce9-6ae254b3acc7 service nova] Releasing lock "refresh_cache-04723ac0-4a7e-4365-ab31-0b7b7ba9959b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:04:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Instance destroyed successfully.
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.objects.instance [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lazy-loading 'resources' on Instance uuid 04723ac0-4a7e-4365-ab31-0b7b7ba9959b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-09-04T23:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1949779981',display_name='tempest-TestShelveInstance-server-1949779981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1949779981',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA3U23sWkgh+8JH0UwhbFuiqxnqxSNXNBaiMRKNDkVghULcVEvTb/z6dH5JMYHN0lSUqERuPEKc5D/V6YJ7KV9XfBaddfab+J4uq4o/u7IlpTmVsPuVzQWOv/7I1OIjDA==',key_name='tempest-TestShelveInstance-962283649',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9120760d601419b93f6d9b8ec092193',ramdisk_id='',reservation_id='r-ne3j9aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-146984119',owner_user_name='tempest-TestShelveInstance-146984119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:02:38Z,user_data=None,user_id='c4b4395e34e548a0b2bf572e5217d070',uuid=04723ac0-4a7e-4365-ab31-0b7b7ba9959b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converting VIF {"id": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "address": "fa:16:3e:11:87:8f", "network": {"id": "66389a49-f526-4506-b4fa-bf6d5138f067", "bridge": "br-int", "label": "tempest-TestShelveInstance-1247291575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9120760d601419b93f6d9b8ec092193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85bc9f7-65", "ovs_interfaceid": "b85bc9f7-653f-4b60-b649-3dcb99440e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_vif [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb85bc9f7-65, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:08 user nova-compute[72954]: INFO os_vif [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:87:8f,bridge_name='br-int',has_traffic_filtering=True,id=b85bc9f7-653f-4b60-b649-3dcb99440e77,network=Network(66389a49-f526-4506-b4fa-bf6d5138f067),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85bc9f7-65')
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HiIolWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:04:08 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5af9ce-c1a1-4461-b2b3-cda370278314]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e8d063-c2cc-4868-9acb-5c96cbf9f604]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:04:08 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:04:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c (non-flash)
Sep 05 00:04:08 user nova-compute[72954]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:04:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1381a4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568e1cb-7c4a-4cac-afe1-c047f6dc974e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f652d87-2cb1-4eb7-b9bd-cc8abdcaf624]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ea6b9-28b3-42aa-b31f-ec8a43495d25]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef2e20-d992-4dbd-a1af-4646931f57d7]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObac27736-48a5bc0a3f16d616', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bac27736', '/dev/disk/by-id/scsi-23438613562633061') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec553d26-484f-4547-a4f7-7b3865e92947]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af3e27f-648d-42ca-8eb4-781d6b78a07c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[10367c21-a3fa-4c37-830b-ed5aa1d94651]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260]
Sep 05 00:04:08 user nova-compute[72954]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c, portal: 172.16.0.220,3260] successful.
Sep 05 00:04:08 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f880bdba-49af-4bf8-ad54-fec4c0f2079c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[26057d06-1406-4f83-918c-075f2849fc53]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] <== disconnect_volume: return (281ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:04:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deleting instance files /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b_del
Sep 05 00:04:08 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deletion of /opt/stack/data/nova/instances/04723ac0-4a7e-4365-ab31-0b7b7ba9959b_del complete
Sep 05 00:04:08 user nova-compute[72954]: INFO nova.compute.manager [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Took 1.14 seconds to destroy the instance on the hypervisor.
Sep 05 00:04:08 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:04:08 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:04:09 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Took 0.51 seconds to deallocate network for instance.
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-unplugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Acquiring lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] No waiting events found dispatching network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:04:09 user nova-compute[72954]: WARNING nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received unexpected event network-vif-plugged-b85bc9f7-653f-4b60-b649-3dcb99440e77 for instance with vm_state active and task_state deleting.
Sep 05 00:04:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-6b9136ec-451e-4d05-8b74-6564d27ca628 req-e135fdaf-ba84-4e34-933e-caf05bbb88b5 service nova] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Received event network-vif-deleted-b85bc9f7-653f-4b60-b649-3dcb99440e77 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:10 user nova-compute[72954]: INFO nova.compute.manager [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Took 0.86 seconds to detach 1 volumes for instance.
Sep 05 00:04:10 user nova-compute[72954]: DEBUG nova.compute.manager [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Deleting volume: f880bdba-49af-4bf8-ad54-fec4c0f2079c {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 05 00:04:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:10 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:04:10 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:04:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:10 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Deleted allocations for instance 04723ac0-4a7e-4365-ab31-0b7b7ba9959b
Sep 05 00:04:10 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-7663a30a-d506-4682-b503-4c7a3ca66130 tempest-TestShelveInstance-146984119 tempest-TestShelveInstance-146984119-project-member] Lock "04723ac0-4a7e-4365-ab31-0b7b7ba9959b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:23 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872248.3618822, 04723ac0-4a7e-4365-ab31-0b7b7ba9959b => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:04:23 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] VM Stopped (Lifecycle Event)
Sep 05 00:04:23 user nova-compute[72954]: DEBUG nova.compute.manager [None req-d6ec0dda-66f7-4fe9-9c35-9fbf40b1ce52 None None] [instance: 04723ac0-4a7e-4365-ab31-0b7b7ba9959b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:04:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:04:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:04:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=25.131103515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f51548c2-5bde-49d5-8635-90abcb11cdd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:04:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:04:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:04:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:04:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:04:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 05 00:04:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:04:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:45 user nova-compute[72954]: INFO nova.compute.manager [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Terminating instance
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-unplugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] No waiting events found dispatching network-vif-unplugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-27f451ee-a039-456e-bf20-bcba1033a4e2 req-861721e7-b0d7-4180-a44c-51f5ba5f4b93 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-unplugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:04:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Instance destroyed successfully.
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'resources' on Instance uuid 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-04T23:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-395860938',display_name='tempest-AttachVolumeNegativeTest-server-395860938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-395860938',id=43,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3gA0vCF+ChG1KG3ujgW772+VFybJ19Uc1pXLhacJmHKxd1BPKojtHQyAX0Sltf5mPK4QEPaCYv37pgBxvTUX5HOXYJQ6n444UHjUxGZmVy5sOTeXhUOQCkqnkt+jHb6w==',key_name='tempest-keypair-808364904',keypairs=<?>,launch_index=0,launched_at=2023-09-04T23:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-arvpu6md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-04T23:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "address": "fa:16:3e:c1:18:7f", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7cd5981-72", "ovs_interfaceid": "f7cd5981-72db-4481-bbfb-a68b7fadc4b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG os_vif [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7cd5981-72, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:04:46 user nova-compute[72954]: INFO os_vif [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:18:7f,bridge_name='br-int',has_traffic_filtering=True,id=f7cd5981-72db-4481-bbfb-a68b7fadc4b3,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7cd5981-72')
Sep 05 00:04:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Deleting instance files /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29_del
Sep 05 00:04:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Deletion of /opt/stack/data/nova/instances/4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29_del complete
Sep 05 00:04:46 user nova-compute[72954]: INFO nova.compute.manager [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Took 0.83 seconds to destroy the instance on the hypervisor.
Sep 05 00:04:46 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:04:46 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:04:48 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Took 1.25 seconds to deallocate network for instance.
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-3ce6d24e-2455-437f-aaf1-b601905fb9c7 req-fc14f3ed-4e68-4ec5-8716-bcbcf563a7be service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-deleted-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] Acquiring lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] No waiting events found dispatching network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:04:48 user nova-compute[72954]: WARNING nova.compute.manager [req-183ba770-0acc-40ce-8916-1b4427fcd885 req-aafec32b-3f3c-48a0-a12b-eefdfbf6fa09 service nova] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Received unexpected event network-vif-plugged-f7cd5981-72db-4481-bbfb-a68b7fadc4b3 for instance with vm_state deleted and task_state None.
Sep 05 00:04:48 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Deleted allocations for instance 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29
Sep 05 00:04:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-95284b6a-6cfa-4490-9dda-40e728f99566 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:04:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:04:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Verify base images {{(pid=72954) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72954) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] f51548c2-5bde-49d5-8635-90abcb11cdd4 is a valid instance name {{(pid=72954) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283
Sep 05 00:05:00 user nova-compute[72954]: WARNING nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Unknown base file: /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Removable base files: /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32 /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118 /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459 /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439 /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283 /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f17ffc44eceff87b9af19c4dde627cf4cb6278a
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d2bdf2067c8c75c867eba2070811bb7a235f5dcc
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e675450031f50f090bcc74cce55e93335c412b32
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f91df794bee4589d59ba5f9673be00eee907c118
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e16d6b51a02780ae799b5389b3ace39ed0121459
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3cf8b39b91c2dcd2d076201ba3cf50de9af45439
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dbbb8ca078988389289a5d47952f304598dc283
Sep 05 00:05:00 user nova-compute[72954]: INFO nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/068c90afba49c28fce0903b062517cd0d3b7e87c
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Verification complete {{(pid=72954) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Verify swap images {{(pid=72954) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Sep 05 00:05:00 user nova-compute[72954]: DEBUG nova.virt.libvirt.imagecache [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Verify ephemeral images {{(pid=72954) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Sep 05 00:05:01 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872286.7336745, 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:05:01 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] VM Stopped (Lifecycle Event)
Sep 05 00:05:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-db91aa44-c6bd-47c8-a064-7d5673494de4 None None] [instance: 4a17d7b8-9e55-4ecd-8f50-7beb84ddfb29] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:05:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:06 user nova-compute[72954]: INFO nova.compute.manager [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Terminating instance
Sep 05 00:05:06 user nova-compute[72954]: DEBUG nova.compute.manager [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-unplugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] No waiting events found dispatching network-vif-unplugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:05:06 user nova-compute[72954]: DEBUG nova.compute.manager [req-5ab89ac1-97f3-47df-8956-472d7a7964f8 req-9667ae1f-4f76-46e1-94f0-9648b8e7a280 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-unplugged-f463327f-1f91-4e54-8d5c-5d0242f0823a for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:05:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Instance destroyed successfully.
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.objects.instance [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid f51548c2-5bde-49d5-8635-90abcb11cdd4 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831204670',display_name='tempest-TestVolumeBootPattern-server-831204670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-831204670',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-h0bngyyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:03:41Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f51548c2-5bde-49d5-8635-90abcb11cdd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "address": "fa:16:3e:30:2b:d1", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf463327f-1f", "ovs_interfaceid": "f463327f-1f91-4e54-8d5c-5d0242f0823a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_vif [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf463327f-1f, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:05:07 user nova-compute[72954]: INFO os_vif [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:2b:d1,bridge_name='br-int',has_traffic_filtering=True,id=f463327f-1f91-4e54-8d5c-5d0242f0823a,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf463327f-1f')
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OVwBQfdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:05:07 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c197a84-c3f2-440c-b2b4-125cd4b9e130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a6c69-f699-496c-a6af-da12e606f80d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:05:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 (non-flash)
Sep 05 00:05:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13015b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09'): ({'sdd'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdd {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[56081936-7af7-47a5-92e6-6e1030e1e707]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d2eaca-ae9f-4a14-87ea-a29b955fd4a7]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdd {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acbc20f-325e-4878-a2a9-a45879f8b742]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d631e-4366-44d5-ad16-0f017c2ea4fa]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdd have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c62ac16', '/dev/disk/by-id/scsi-1SCST_BIO2c62ac16-7a586fdbd3b56d64', '/dev/disk/by-id/scsi-23761353836666462') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c5eec-eb6d-48b3-ae01-8c4610c6cdde]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e131e880-3dd2-4743-a641-2aca1f4a3880]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb4fdf8-bee6-4028-882c-2dce3c1324dc]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260]
Sep 05 00:05:07 user nova-compute[72954]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09, portal: 172.16.0.220,3260] successful.
Sep 05 00:05:07 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7f31c69-a9d3-4905-922d-1a52cfb45c09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f2abef-b8be-4610-859f-7b69da7878ff]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (261ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:05:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Deleting instance files /opt/stack/data/nova/instances/f51548c2-5bde-49d5-8635-90abcb11cdd4_del
Sep 05 00:05:07 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Deletion of /opt/stack/data/nova/instances/f51548c2-5bde-49d5-8635-90abcb11cdd4_del complete
Sep 05 00:05:07 user nova-compute[72954]: INFO nova.compute.manager [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Took 1.10 seconds to destroy the instance on the hypervisor.
Sep 05 00:05:07 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:05:07 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:05:07 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Took 0.43 seconds to deallocate network for instance.
Sep 05 00:05:08 user nova-compute[72954]: INFO nova.compute.manager [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Took 0.82 seconds to detach 1 volumes for instance.
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Deleting volume: e7f31c69-a9d3-4905-922d-1a52cfb45c09 {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] Acquiring lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] No waiting events found dispatching network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:05:08 user nova-compute[72954]: WARNING nova.compute.manager [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received unexpected event network-vif-plugged-f463327f-1f91-4e54-8d5c-5d0242f0823a for instance with vm_state deleted and task_state None.
Sep 05 00:05:08 user nova-compute[72954]: DEBUG nova.compute.manager [req-1aab9478-d57f-4806-b791-7570124879c0 req-85bb6b36-8436-4b61-b519-5570f750dad3 service nova] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Received event network-vif-deleted-f463327f-1f91-4e54-8d5c-5d0242f0823a {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:08 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance f51548c2-5bde-49d5-8635-90abcb11cdd4
Sep 05 00:05:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-670cd204-c9be-4669-b13e-138654d34cf8 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f51548c2-5bde-49d5-8635-90abcb11cdd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872307.1047683, f51548c2-5bde-49d5-8635-90abcb11cdd4 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:05:22 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] VM Stopped (Lifecycle Event)
Sep 05 00:05:22 user nova-compute[72954]: DEBUG nova.compute.manager [None req-03497789-0c57-4d93-b7dd-40371949095c None None] [instance: f51548c2-5bde-49d5-8635-90abcb11cdd4] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:05:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:05:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:05:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.157634735107422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:05:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:35 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:05:39 user nova-compute[72954]: INFO nova.compute.claims [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Claim successful on node user
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:05:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.policy [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61e815f67e4f509e9e33e97201759c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f019505deedc4dcba8ef93923b81c192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:05:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Creating image(s)
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Successfully created port: 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.248s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk 1073741824" returned: 0 in 0.052s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.173s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Cannot resize image /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Ensure instance console log exists: /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Successfully updated port: 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquired lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-changed-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.compute.manager [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Refreshing instance network info cache due to event network-changed-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] Acquiring lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:40 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.neutron [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Releasing lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Instance network_info: |[{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] Acquired lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Refreshing network info cache for port 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Start _get_guest_xml network_info=[{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:05:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:05:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1709591997',display_name='tempest-AttachVolumeNegativeTest-server-1709591997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1709591997',id=46,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvYzzBLGmPpNWF0G51VNkum08f3jxm29OiKjn1D8XOCp26/1Wo5Ps9SgCQCMI9WMC7LZ4DN/fMtY07n8Wuw4Q9EiEhfdLNb1vpqu/2mjuNRFEG8PPvG4cFjUoY+uQ+2RQ==',key_name='tempest-keypair-197534573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-lwzrzivt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=8c80af95-ba10-4c2a-89a2-318bcfb0b13b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:05:41 user nova-compute[72954]:   <uuid>8c80af95-ba10-4c2a-89a2-318bcfb0b13b</uuid>
Sep 05 00:05:41 user nova-compute[72954]:   <name>instance-0000002e</name>
Sep 05 00:05:41 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:05:41 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:05:41 user nova-compute[72954]:   <metadata>
Sep 05 00:05:41 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:05:41 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1709591997</nova:name>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:05:41</nova:creationTime>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:05:41 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:05:41 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:owner>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:user uuid="ff61e815f67e4f509e9e33e97201759c">tempest-AttachVolumeNegativeTest-2127434441-project-member</nova:user>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:project uuid="f019505deedc4dcba8ef93923b81c192">tempest-AttachVolumeNegativeTest-2127434441</nova:project>
Sep 05 00:05:41 user nova-compute[72954]:       </nova:owner>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 05 00:05:41 user nova-compute[72954]:       <nova:ports>
Sep 05 00:05:41 user nova-compute[72954]:         <nova:port uuid="3cc47c67-2f84-4bde-a4d0-9f790f29f3c7">
Sep 05 00:05:41 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Sep 05 00:05:41 user nova-compute[72954]:         </nova:port>
Sep 05 00:05:41 user nova-compute[72954]:       </nova:ports>
Sep 05 00:05:41 user nova-compute[72954]:     </nova:instance>
Sep 05 00:05:41 user nova-compute[72954]:   </metadata>
Sep 05 00:05:41 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:05:41 user nova-compute[72954]:     <system>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="serial">8c80af95-ba10-4c2a-89a2-318bcfb0b13b</entry>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="uuid">8c80af95-ba10-4c2a-89a2-318bcfb0b13b</entry>
Sep 05 00:05:41 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:05:41 user nova-compute[72954]:     </system>
Sep 05 00:05:41 user nova-compute[72954]:   </sysinfo>
Sep 05 00:05:41 user nova-compute[72954]:   <os>
Sep 05 00:05:41 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:05:41 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:05:41 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:05:41 user nova-compute[72954]:   </os>
Sep 05 00:05:41 user nova-compute[72954]:   <features>
Sep 05 00:05:41 user nova-compute[72954]:     <acpi/>
Sep 05 00:05:41 user nova-compute[72954]:     <apic/>
Sep 05 00:05:41 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:05:41 user nova-compute[72954]:   </features>
Sep 05 00:05:41 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:05:41 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:05:41 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:05:41 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:05:41 user nova-compute[72954]:   </clock>
Sep 05 00:05:41 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:05:41 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:05:41 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:05:41 user nova-compute[72954]:   </cpu>
Sep 05 00:05:41 user nova-compute[72954]:   <devices>
Sep 05 00:05:41 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 05 00:05:41 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 05 00:05:41 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk"/>
Sep 05 00:05:41 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:05:41 user nova-compute[72954]:     </disk>
Sep 05 00:05:41 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:05:41 user nova-compute[72954]:       <mac address="fa:16:3e:a1:0e:6a"/>
Sep 05 00:05:41 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:05:41 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:05:41 user nova-compute[72954]:       <target dev="tap3cc47c67-2f"/>
Sep 05 00:05:41 user nova-compute[72954]:     </interface>
Sep 05 00:05:41 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:05:41 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/console.log" append="off"/>
Sep 05 00:05:41 user nova-compute[72954]:     </serial>
Sep 05 00:05:41 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:05:41 user nova-compute[72954]:     <video>
Sep 05 00:05:41 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:05:41 user nova-compute[72954]:     </video>
Sep 05 00:05:41 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:05:41 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:05:41 user nova-compute[72954]:     </rng>
Sep 05 00:05:41 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:05:41 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:05:41 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:05:41 user nova-compute[72954]:     </memballoon>
Sep 05 00:05:41 user nova-compute[72954]:   </devices>
Sep 05 00:05:41 user nova-compute[72954]: </domain>
Sep 05 00:05:41 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1709591997',display_name='tempest-AttachVolumeNegativeTest-server-1709591997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1709591997',id=46,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvYzzBLGmPpNWF0G51VNkum08f3jxm29OiKjn1D8XOCp26/1Wo5Ps9SgCQCMI9WMC7LZ4DN/fMtY07n8Wuw4Q9EiEhfdLNb1vpqu/2mjuNRFEG8PPvG4cFjUoY+uQ+2RQ==',key_name='tempest-keypair-197534573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-lwzrzivt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=8c80af95-ba10-4c2a-89a2-318bcfb0b13b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG os_vif [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cc47c67-2f, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cc47c67-2f, col_values=(('external_ids', {'iface-id': '3cc47c67-2f84-4bde-a4d0-9f790f29f3c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:0e:6a', 'vm-uuid': '8c80af95-ba10-4c2a-89a2-318bcfb0b13b'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:41 user nova-compute[72954]: INFO os_vif [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f')
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:a1:0e:6a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updated VIF entry in instance network info cache for port 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG nova.network.neutron [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:05:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-611a0481-2136-46f2-aa70-b39bd7bcd10d req-dbcf94b7-6fcd-460f-b0d1-9420c77945e7 service nova] Releasing lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:05:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] No waiting events found dispatching network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:05:43 user nova-compute[72954]: WARNING nova.compute.manager [req-25a88c7e-37e4-484c-a07f-e6c926934bca req-e06e57a9-5af7-4c5f-af1e-f60e27006809 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received unexpected event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 for instance with vm_state building and task_state spawning.
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Skipping network cache update for instance because it is Building. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9918}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:43 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:05:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872345.1677475, 8c80af95-ba10-4c2a-89a2-318bcfb0b13b => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] VM Resumed (Lifecycle Event)
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Instance spawned successfully.
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872345.1690714, 8c80af95-ba10-4c2a-89a2-318bcfb0b13b => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] VM Started (Lifecycle Event)
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] No waiting events found dispatching network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:05:45 user nova-compute[72954]: WARNING nova.compute.manager [req-7edce7aa-4dd5-4309-8065-7ce25064ec7a req-36abb5fb-7d2e-413f-af28-a6ac46bb48c9 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received unexpected event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 for instance with vm_state building and task_state spawning.
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Took 5.60 seconds to spawn the instance on the hypervisor.
Sep 05 00:05:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:05:45 user nova-compute[72954]: INFO nova.compute.manager [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Took 6.12 seconds to build instance.
Sep 05 00:05:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a6146882-c929-4ea5-8bfd-8bfacf48fe9c tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.217s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:05:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 05 00:05:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 05 00:05:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:05:59 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:05:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 05 00:06:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:10 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:06:27 user nova-compute[72954]: INFO nova.compute.claims [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Claim successful on node user
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:06:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.policy [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:06:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Booting with volume 418f2825-376e-4153-ba82-2e3e5ef4978b at /dev/vda
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99beafc1-3c30-4be1-8a44-854d150805f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a70f53-1c4b-409a-92ac-3440ec55e446]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a02d02-a013-45f9-a857-e6759d96fc5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d6b92e-0159-4315-aaf9-4b711e50393a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:06:28 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:06:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570d556-5356-4d99-9d56-11a2211ca566]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating existing volume attachment record: c1d33fb0-f683-464a-b1bc-692b6579c31a {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:06:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Successfully created port: f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:29 user nova-compute[72954]: WARNING nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid a536283b-931d-469a-9711-469f6464f9a9 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Successfully updated port: f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-changed-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Refreshing instance network info cache due to event network-changed-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] Acquiring lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Instance network_info: |[{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] Acquired lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:06:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Refreshing network info cache for port f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:06:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updated VIF entry in instance network info cache for port f043d6d0-f9d7-41f6-ac76-3ab6c48423cb. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:06:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:06:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-24896ebc-1763-45a5-a2a5-ab390763b4f5 req-d68d93e6-7224-4bd1-84c7-327172f82850 service nova] Releasing lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:06:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:32 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:32 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:06:33 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.127010345458984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a536283b-931d-469a-9711-469f6464f9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 05 00:06:33 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 05 00:06:34 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 05 00:06:34 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:06:34 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:06:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:06:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:06:37 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:06:41 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Creating image(s)
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Ensure instance console log exists: /opt/stack/data/nova/instances/a536283b-931d-469a-9711-469f6464f9a9/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Start _get_guest_xml network_info=[{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOALqhoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a536283b-931d-469a-9711-469f6464f9a9', 'attached_at': '', 'detached_at': '', 'volume_id': '418f2825-376e-4153-ba82-2e3e5ef4978b', 'serial': '418f2825-376e-4153-ba82-2e3e5ef4978b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'c1d33fb0-f683-464a-b1bc-692b6579c31a', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:06:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:06:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOALqhoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:06:41 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:06:41 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:06:41 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e8643-5b13-4a41-9c04-268c1801234d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:06:41 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df3eb0-fbec-40a2-ac84-99c332834336]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b] added
Sep 05 00:06:41 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c60e82-1fac-4bcf-9dc6-1bd435b9c8e0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:41 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff53e5-edad-4740-85e1-390c6ae87135]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOALqhoE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bOALqhoE" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[004acdbb-47b0-4bbf-8f08-7600b259a28c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bOALqhoE'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca989653-adb9-4497-9279-79741b286092]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb9d6b-da79-4fca-add0-c9e7b926169a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:06:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:06:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:06:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 05 00:06:42 user nova-compute[72954]: 
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5ed1e-94da-428d-a504-8f029fc08452]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260]
Sep 05 00:06:42 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260] successful.
Sep 05 00:06:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27cbba4-40b6-4d5e-85db-1b3910da226f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64965f1-9c5c-481a-bba5-ba8e8ce59c02]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:06:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:06:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b81c7-2885-4970-8a02-d6cd876393ea]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:06:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOALqhoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26262646134316665', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262646134316665', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-535289377',display_name='tempest-TestVolumeBootPattern-volume-backed-server-535289377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-535289377',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOf86vPHDFFScwmcSweHbnoAMkHGI1u68+zmizFY+KnwrBJEpfjuu17u+XCR/Edj11y3WVEL+woMKvdBZUs7fPasa4rwEttmv6qprGkBLCl3fXeMg8rMv8XC3YMowsEew==',key_name='tempest-keypair-1516749243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-1do3mo3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=a536283b-931d-469a-9711-469f6464f9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.objects.instance [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid a536283b-931d-469a-9711-469f6464f9a9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:06:43 user nova-compute[72954]:   <uuid>a536283b-931d-469a-9711-469f6464f9a9</uuid>
Sep 05 00:06:43 user nova-compute[72954]:   <name>instance-0000002f</name>
Sep 05 00:06:43 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:06:43 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:06:43 user nova-compute[72954]:   <metadata>
Sep 05 00:06:43 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:06:43 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:06:43 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-535289377</nova:name>
Sep 05 00:06:43 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:06:41</nova:creationTime>
Sep 05 00:06:43 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:06:43 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:06:43 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:06:43 user nova-compute[72954]:       <nova:owner>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:06:43 user nova-compute[72954]:       </nova:owner>
Sep 05 00:06:43 user nova-compute[72954]:       <nova:ports>
Sep 05 00:06:43 user nova-compute[72954]:         <nova:port uuid="f043d6d0-f9d7-41f6-ac76-3ab6c48423cb">
Sep 05 00:06:43 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 05 00:06:43 user nova-compute[72954]:         </nova:port>
Sep 05 00:06:43 user nova-compute[72954]:       </nova:ports>
Sep 05 00:06:43 user nova-compute[72954]:     </nova:instance>
Sep 05 00:06:43 user nova-compute[72954]:   </metadata>
Sep 05 00:06:43 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:06:43 user nova-compute[72954]:     <system>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="serial">a536283b-931d-469a-9711-469f6464f9a9</entry>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="uuid">a536283b-931d-469a-9711-469f6464f9a9</entry>
Sep 05 00:06:43 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:06:43 user nova-compute[72954]:     </system>
Sep 05 00:06:43 user nova-compute[72954]:   </sysinfo>
Sep 05 00:06:43 user nova-compute[72954]:   <os>
Sep 05 00:06:43 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:06:43 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:06:43 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:06:43 user nova-compute[72954]:   </os>
Sep 05 00:06:43 user nova-compute[72954]:   <features>
Sep 05 00:06:43 user nova-compute[72954]:     <acpi/>
Sep 05 00:06:43 user nova-compute[72954]:     <apic/>
Sep 05 00:06:43 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:06:43 user nova-compute[72954]:   </features>
Sep 05 00:06:43 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:06:43 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:06:43 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:06:43 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:06:43 user nova-compute[72954]:   </clock>
Sep 05 00:06:43 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:06:43 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:06:43 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:06:43 user nova-compute[72954]:   </cpu>
Sep 05 00:06:43 user nova-compute[72954]:   <devices>
Sep 05 00:06:43 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:06:43 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:06:43 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 05 00:06:43 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:06:43 user nova-compute[72954]:       <serial>418f2825-376e-4153-ba82-2e3e5ef4978b</serial>
Sep 05 00:06:43 user nova-compute[72954]:     </disk>
Sep 05 00:06:43 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:06:43 user nova-compute[72954]:       <mac address="fa:16:3e:c1:57:95"/>
Sep 05 00:06:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:06:43 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:06:43 user nova-compute[72954]:       <target dev="tapf043d6d0-f9"/>
Sep 05 00:06:43 user nova-compute[72954]:     </interface>
Sep 05 00:06:43 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:06:43 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/a536283b-931d-469a-9711-469f6464f9a9/console.log" append="off"/>
Sep 05 00:06:43 user nova-compute[72954]:     </serial>
Sep 05 00:06:43 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:06:43 user nova-compute[72954]:     <video>
Sep 05 00:06:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:06:43 user nova-compute[72954]:     </video>
Sep 05 00:06:43 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:06:43 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:06:43 user nova-compute[72954]:     </rng>
Sep 05 00:06:43 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:06:43 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:06:43 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:06:43 user nova-compute[72954]:     </memballoon>
Sep 05 00:06:43 user nova-compute[72954]:   </devices>
Sep 05 00:06:43 user nova-compute[72954]: </domain>
Sep 05 00:06:43 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-535289377',display_name='tempest-TestVolumeBootPattern-volume-backed-server-535289377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-535289377',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOf86vPHDFFScwmcSweHbnoAMkHGI1u68+zmizFY+KnwrBJEpfjuu17u+XCR/Edj11y3WVEL+woMKvdBZUs7fPasa4rwEttmv6qprGkBLCl3fXeMg8rMv8XC3YMowsEew==',key_name='tempest-keypair-1516749243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-1do3mo3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=a536283b-931d-469a-9711-469f6464f9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG os_vif [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf043d6d0-f9, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf043d6d0-f9, col_values=(('external_ids', {'iface-id': 'f043d6d0-f9d7-41f6-ac76-3ab6c48423cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:57:95', 'vm-uuid': 'a536283b-931d-469a-9711-469f6464f9a9'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:43 user nova-compute[72954]: INFO os_vif [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9')
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:06:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:c1:57:95, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] No waiting events found dispatching network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:06:44 user nova-compute[72954]: WARNING nova.compute.manager [req-e8ffd240-c40e-4772-9900-d9608b81de48 req-886389c8-2211-44bd-be48-3b0667fb49a0 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received unexpected event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb for instance with vm_state building and task_state spawning.
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Skipping network cache update for instance because it is Building. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9918}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:06:44 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:06:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872406.576257, a536283b-931d-469a-9711-469f6464f9a9 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] VM Resumed (Lifecycle Event)
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] Instance spawned successfully.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872406.579339, a536283b-931d-469a-9711-469f6464f9a9 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] VM Started (Lifecycle Event)
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] No waiting events found dispatching network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:06:46 user nova-compute[72954]: WARNING nova.compute.manager [req-625ec175-3d86-453c-a036-63cb35467517 req-96ce461c-4921-4c54-a043-ec510dcff341 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received unexpected event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb for instance with vm_state building and task_state spawning.
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Took 4.86 seconds to spawn the instance on the hypervisor.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Took 19.10 seconds to build instance.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-2b175f33-16a0-4b97-b8cc-e74ff641f121 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.187s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "a536283b-931d-469a-9711-469f6464f9a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.606s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:06:46 user nova-compute[72954]: INFO nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Sep 05 00:06:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "a536283b-931d-469a-9711-469f6464f9a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:06:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:06:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:07:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:07:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-changed-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Refreshing instance network info cache due to event network-changed-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] Acquiring lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] Acquired lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Refreshing network info cache for port 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updated VIF entry in instance network info cache for port 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:07:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-47f0fc62-1713-43a8-9087-2b098ebba2d1 req-1b4db669-69de-4594-a88d-936eeeceb99d service nova] Releasing lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:07:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:07:33 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:34 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:07:34 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.12546157836914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a536283b-931d-469a-9711-469f6464f9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:07:34 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG nova.objects.instance [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:07:35 user nova-compute[72954]: INFO nova.compute.manager [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Attaching volume d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe to /dev/vdb
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.utils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d95554-0033-44e2-8de9-f219adbd6ec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e2f429-4939-4c16-9a5d-3b09ee9f39da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66ed8a-9bbe-4c8d-9973-9e4858886928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e829609-9adc-4917-823a-7204d2dd4410]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:07:35 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:07:35 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82dd453-0a6a-435a-9b37-364a23f8c567]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG os_brick.utils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:07:35 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating existing volume attachment record: 42d97238-9989-4b9e-94f9-463db38cf2d7 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:07:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:07:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [{"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-8c80af95-ba10-4c2a-89a2-318bcfb0b13b" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:07:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:07:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUWimQxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:07:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:07:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:07:49 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af62f0-ac93-4eea-8580-a1271320fd1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:07:49 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0be6db-49e5-4ade-8921-96b25cdc9be1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe] added
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555fd0e-0eed-45fa-bddb-f8046ffb1872]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eddbdf1-da1b-4f68-9cc8-66ddff16102b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUWimQxF {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUWimQxF" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c3411-10f6-4255-b6f6-2470dcca6741]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUWimQxF'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3879c29b-3345-4ff5-8628-93a0b7038efb]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ce583d-fa8e-4cb6-b377-476bcf0ae380]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285bc42-0846-44cf-b8e9-b9bee59f33d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260]
Sep 05 00:07:49 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260] successful.
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb9f47-8b00-4235-8580-0e78bb7a34bf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e055b4a8-020f-4aa8-aa90-bb6a5b4c52b5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:49 user nova-compute[72954]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:49 user nova-compute[72954]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)
Sep 05 00:07:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c8685-6a37-437a-8156-18de63753f72]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:07:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUWimQxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:07:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:07:50 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26335316561653133', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:07:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335316561653133', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:07:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:07:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] attach device xml: <disk type="block" device="disk">
Sep 05 00:07:50 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:07:50 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 05 00:07:50 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:07:50 user nova-compute[72954]:   <serial>d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe</serial>
Sep 05 00:07:50 user nova-compute[72954]: </disk>
Sep 05 00:07:50 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:a1:0e:6a, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aebde0be-a647-43b5-9330-efeb19c62350 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.737s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:07:51 user nova-compute[72954]: INFO nova.compute.manager [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Detaching volume d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe
Sep 05 00:07:51 user nova-compute[72954]: INFO nova.virt.block_device [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Attempting to driver detach volume d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe from mountpoint /dev/vdb
Sep 05 00:07:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Attempting to detach device vdb from instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 05 00:07:51 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:07:51 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:07:51 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 05 00:07:51 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:07:51 user nova-compute[72954]:   <serial>d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe</serial>
Sep 05 00:07:51 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:07:51 user nova-compute[72954]: </disk>
Sep 05 00:07:51 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:07:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b from the persistent domain config.
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:07:52 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:07:52 user nova-compute[72954]:   <source dev="/dev/sdc"/>
Sep 05 00:07:52 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:07:52 user nova-compute[72954]:   <serial>d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe</serial>
Sep 05 00:07:52 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:07:52 user nova-compute[72954]: </disk>
Sep 05 00:07:52 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693872472.4055028, 8c80af95-ba10-4c2a-89a2-318bcfb0b13b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 05 00:07:52 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b from the live domain config.
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUWimQxF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:07:52 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee7315-a3be-47bf-b62c-fa0061cf20c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[88da2b75-a7fb-4b38-9db9-9b1ddfdb7672]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:52 user nova-compute[72954]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)
Sep 05 00:07:52 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:07:52 user nova-compute[72954]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe (non-flash)
Sep 05 00:07:52 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1182bc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a36e43-277c-40a7-8b29-a483aa3932dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef36adf-e9a0-431b-a256-aea589d17037]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28b43b-0396-453d-8024-2285fbeb0501]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ee591-e1b7-4ec6-88eb-3a922a677f70]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1177237-49ce-4507-b49f-df0dec32d36d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db66aa-e708-4fd0-a3f2-fe445194ef78]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260]
Sep 05 00:07:52 user nova-compute[72954]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe, portal: 172.16.0.220,3260] successful.
Sep 05 00:07:52 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d36b14bb-4d2f-4d1c-9f15-abcdc25b06fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[314d9029-1749-4c8c-b0dd-f38d164a1345]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== disconnect_volume: return (252ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:07:52 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:07:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:07:53 user nova-compute[72954]: DEBUG nova.objects.instance [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:07:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-17bcee51-fd09-4d24-ac5d-90aae3de8c8d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.615s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:07:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-changed-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG nova.compute.manager [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Refreshing instance network info cache due to event network-changed-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] Acquiring lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] Acquired lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:08:18 user nova-compute[72954]: DEBUG nova.network.neutron [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Refreshing network info cache for port f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:08:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updated VIF entry in instance network info cache for port f043d6d0-f9d7-41f6-ac76-3ab6c48423cb. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:08:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4d2e531a-3228-4512-91de-cf4a97990bc5 req-953f8c50-7201-44b6-8f13-417bcbaeddec service nova] Releasing lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:08:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:08:34 user nova-compute[72954]: INFO nova.compute.claims [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Claim successful on node user
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:08:34 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:08:34 user nova-compute[72954]: INFO nova.virt.block_device [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Booting with volume snapshot ad284067-9537-4bba-a103-4aa2cec6b719 at /dev/vda
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.policy [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:08:34 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:08:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.123886108398438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Successfully created port: 1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a536283b-931d-469a-9711-469f6464f9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:08:35 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Successfully updated port: 1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-changed-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.compute.manager [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Refreshing instance network info cache due to event network-changed-1ef254ba-2ccf-4d6c-b89b-759f67bc9708. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] Acquiring lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updating instance_info_cache with network_info: [{"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Instance network_info: |[{"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] Acquired lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:08:36 user nova-compute[72954]: DEBUG nova.network.neutron [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Refreshing network info cache for port 1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:08:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updated VIF entry in instance network info cache for port 1ef254ba-2ccf-4d6c-b89b-759f67bc9708. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:08:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updating instance_info_cache with network_info: [{"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a2c197c8-ccc8-4b03-8fb3-daa51b1fafb0 req-34b6a019-42bf-4ace-b92b-e2906650c8a0 service nova] Releasing lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:08:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:39 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.utils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[97199c0a-bb28-4d56-a44e-e750a19c5399]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac198788-93b0-4eec-b176-529c66163253]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddee88b-38ea-4185-83b2-2c3ef01497f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9623b91e-45e9-4845-a32a-f9ac8b3b6e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:08:40 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:08:40 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e0bbf-dcba-47f3-abb0-130123a99882]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG os_brick.utils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:08:40 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updating existing volume attachment record: c9d147f2-445f-459e-a976-ebd94a4626be {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:08:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:42 user nova-compute[72954]: INFO nova.compute.manager [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Terminating instance
Sep 05 00:08:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-unplugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] No waiting events found dispatching network-vif-unplugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:08:42 user nova-compute[72954]: DEBUG nova.compute.manager [req-f3730f22-9369-4279-9f94-eacd8066e011 req-0d6939e4-52d7-405f-8bfd-6441316a0698 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-unplugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Instance destroyed successfully.
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.objects.instance [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'resources' on Instance uuid 8c80af95-ba10-4c2a-89a2-318bcfb0b13b {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1709591997',display_name='tempest-AttachVolumeNegativeTest-server-1709591997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1709591997',id=46,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvYzzBLGmPpNWF0G51VNkum08f3jxm29OiKjn1D8XOCp26/1Wo5Ps9SgCQCMI9WMC7LZ4DN/fMtY07n8Wuw4Q9EiEhfdLNb1vpqu/2mjuNRFEG8PPvG4cFjUoY+uQ+2RQ==',key_name='tempest-keypair-197534573',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:05:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-lwzrzivt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=8c80af95-ba10-4c2a-89a2-318bcfb0b13b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "address": "fa:16:3e:a1:0e:6a", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cc47c67-2f", "ovs_interfaceid": "3cc47c67-2f84-4bde-a4d0-9f790f29f3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG os_vif [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cc47c67-2f, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:08:43 user nova-compute[72954]: INFO os_vif [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:0e:6a,bridge_name='br-int',has_traffic_filtering=True,id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cc47c67-2f')
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Deleting instance files /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b_del
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Deletion of /opt/stack/data/nova/instances/8c80af95-ba10-4c2a-89a2-318bcfb0b13b_del complete
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.compute.manager [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Took 0.85 seconds to destroy the instance on the hypervisor.
Sep 05 00:08:43 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Took 0.76 seconds to deallocate network for instance.
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-5e971175-947e-4387-97a9-b918cfdb5492 req-42eab8d6-80c2-47cc-b970-9542ee9cfe78 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-deleted-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:43 user nova-compute[72954]: INFO nova.compute.manager [req-5e971175-947e-4387-97a9-b918cfdb5492 req-42eab8d6-80c2-47cc-b970-9542ee9cfe78 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Neutron deleted interface 3cc47c67-2f84-4bde-a4d0-9f790f29f3c7; detaching it from the instance and deleting it from the info cache
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.network.neutron [req-5e971175-947e-4387-97a9-b918cfdb5492 req-42eab8d6-80c2-47cc-b970-9542ee9cfe78 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG nova.compute.manager [req-5e971175-947e-4387-97a9-b918cfdb5492 req-42eab8d6-80c2-47cc-b970-9542ee9cfe78 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Detach interface failed, port_id=3cc47c67-2f84-4bde-a4d0-9f790f29f3c7, reason: Instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:44 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Deleted allocations for instance 8c80af95-ba10-4c2a-89a2-318bcfb0b13b
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-3cc6e8af-2d69-4db9-9efc-9271c67116d9 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] Acquiring lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] Lock "8c80af95-ba10-4c2a-89a2-318bcfb0b13b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:44 user nova-compute[72954]: DEBUG nova.compute.manager [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] No waiting events found dispatching network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:08:44 user nova-compute[72954]: WARNING nova.compute.manager [req-df325a3e-8bfd-474b-92f8-0f1ad67d1b98 req-0c001098-5684-42af-aa56-06f3096613a1 service nova] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Received unexpected event network-vif-plugged-3cc47c67-2f84-4bde-a4d0-9f790f29f3c7 for instance with vm_state deleted and task_state None.
Sep 05 00:08:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:08:48 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:08:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:08:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:08:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:08:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:08:54 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Creating image(s)
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Ensure instance console log exists: /opt/stack/data/nova/instances/d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Start _get_guest_xml network_info=[{"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-09-05T00:08:21Z,direct_url=<?>,disk_format='qcow2',id=545f23b4-86c9-4edb-8b33-f3fe759ae315,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-494061301',owner='976fc195b97d48a58066e69ccfd0598f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-09-05T00:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZONjxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3', 'attached_at': '', 'detached_at': '', 'volume_id': '82d79781-a743-4942-9f41-5fbd393276c3', 'serial': '82d79781-a743-4942-9f41-5fbd393276c3'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'c9d147f2-445f-459e-a976-ebd94a4626be', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:08:54 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:08:54 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-09-05T00:08:21Z,direct_url=<?>,disk_format='qcow2',id=545f23b4-86c9-4edb-8b33-f3fe759ae315,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-494061301',owner='976fc195b97d48a58066e69ccfd0598f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-09-05T00:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZONjxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:08:54 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:08:54 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:08:54 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[5675c355-0034-4336-a586-4e854ccea1fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:08:54 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[60859074-4577-46c4-87f9-d2970d853b7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3] added
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[e045c4aa-22c5-4ff7-8d7f-cdcc25870fca]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3295e2b7-2f62-4842-bf03-1d2db8359d9a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZONjxzk {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AZONjxzk" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2c032-db07-4cc4-8773-c2109fe1c5af]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AZONjxzk'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3daee5-5247-467a-ac93-916ead2d1259]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6725828a-6b9c-49c2-9fbe-f803bad75bba]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ececa-abc0-4ffd-a242-67bc5560b442]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260]
Sep 05 00:08:54 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260] successful.
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4260c73-b463-4021-90d5-79078b37886b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ccd78-b8be-412d-a544-1dbc22dc48d1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:08:54 user nova-compute[72954]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:08:54 user nova-compute[72954]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)
Sep 05 00:08:54 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de3557-907a-4301-b9a4-e75c428c9557]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:08:54 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:08:55 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:08:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZONjxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:08:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:08:55 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23365653263306230', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:08:55 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365653263306230', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1803560913',id=48,image_ref='545f23b4-86c9-4edb-8b33-f3fe759ae315',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHtJJJr3Jk79veTO2eerag/L9C+aKrRk1wBuh3+IU0eo9Uq5ECguxPv8hSAABVJPAarBs0TuUpMoc08LPw/oT3l9F7mO0U6BM2RF9vn2WdfBJbWcK8phzp/uxI/zoFfwg==',key_name='tempest-keypair-1682915602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-gn5lom54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1950575880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.objects.instance [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:08:56 user nova-compute[72954]:   <uuid>d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3</uuid>
Sep 05 00:08:56 user nova-compute[72954]:   <name>instance-00000030</name>
Sep 05 00:08:56 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:08:56 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:08:56 user nova-compute[72954]:   <metadata>
Sep 05 00:08:56 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:08:56 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1803560913</nova:name>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:08:54</nova:creationTime>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:08:56 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:08:56 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:owner>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:08:56 user nova-compute[72954]:       </nova:owner>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:root type="image" uuid="545f23b4-86c9-4edb-8b33-f3fe759ae315"/>
Sep 05 00:08:56 user nova-compute[72954]:       <nova:ports>
Sep 05 00:08:56 user nova-compute[72954]:         <nova:port uuid="1ef254ba-2ccf-4d6c-b89b-759f67bc9708">
Sep 05 00:08:56 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Sep 05 00:08:56 user nova-compute[72954]:         </nova:port>
Sep 05 00:08:56 user nova-compute[72954]:       </nova:ports>
Sep 05 00:08:56 user nova-compute[72954]:     </nova:instance>
Sep 05 00:08:56 user nova-compute[72954]:   </metadata>
Sep 05 00:08:56 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:08:56 user nova-compute[72954]:     <system>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="serial">d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3</entry>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="uuid">d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3</entry>
Sep 05 00:08:56 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:08:56 user nova-compute[72954]:     </system>
Sep 05 00:08:56 user nova-compute[72954]:   </sysinfo>
Sep 05 00:08:56 user nova-compute[72954]:   <os>
Sep 05 00:08:56 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:08:56 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:08:56 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:08:56 user nova-compute[72954]:   </os>
Sep 05 00:08:56 user nova-compute[72954]:   <features>
Sep 05 00:08:56 user nova-compute[72954]:     <acpi/>
Sep 05 00:08:56 user nova-compute[72954]:     <apic/>
Sep 05 00:08:56 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:08:56 user nova-compute[72954]:   </features>
Sep 05 00:08:56 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:08:56 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:08:56 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:08:56 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:08:56 user nova-compute[72954]:   </clock>
Sep 05 00:08:56 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:08:56 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:08:56 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:08:56 user nova-compute[72954]:   </cpu>
Sep 05 00:08:56 user nova-compute[72954]:   <devices>
Sep 05 00:08:56 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:08:56 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:08:56 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 05 00:08:56 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:08:56 user nova-compute[72954]:       <serial>82d79781-a743-4942-9f41-5fbd393276c3</serial>
Sep 05 00:08:56 user nova-compute[72954]:     </disk>
Sep 05 00:08:56 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:08:56 user nova-compute[72954]:       <mac address="fa:16:3e:35:4d:cf"/>
Sep 05 00:08:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:08:56 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:08:56 user nova-compute[72954]:       <target dev="tap1ef254ba-2c"/>
Sep 05 00:08:56 user nova-compute[72954]:     </interface>
Sep 05 00:08:56 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:08:56 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3/console.log" append="off"/>
Sep 05 00:08:56 user nova-compute[72954]:     </serial>
Sep 05 00:08:56 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:08:56 user nova-compute[72954]:     <video>
Sep 05 00:08:56 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:08:56 user nova-compute[72954]:     </video>
Sep 05 00:08:56 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:08:56 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:08:56 user nova-compute[72954]:     </rng>
Sep 05 00:08:56 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:08:56 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:08:56 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:08:56 user nova-compute[72954]:     </memballoon>
Sep 05 00:08:56 user nova-compute[72954]:   </devices>
Sep 05 00:08:56 user nova-compute[72954]: </domain>
Sep 05 00:08:56 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1803560913',id=48,image_ref='545f23b4-86c9-4edb-8b33-f3fe759ae315',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHtJJJr3Jk79veTO2eerag/L9C+aKrRk1wBuh3+IU0eo9Uq5ECguxPv8hSAABVJPAarBs0TuUpMoc08LPw/oT3l9F7mO0U6BM2RF9vn2WdfBJbWcK8phzp/uxI/zoFfwg==',key_name='tempest-keypair-1682915602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-gn5lom54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1950575880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG os_vif [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ef254ba-2c, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ef254ba-2c, col_values=(('external_ids', {'iface-id': '1ef254ba-2ccf-4d6c-b89b-759f67bc9708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:4d:cf', 'vm-uuid': 'd1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:56 user nova-compute[72954]: INFO os_vif [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c')
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:08:56 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:35:4d:cf, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:57 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] No waiting events found dispatching network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:08:57 user nova-compute[72954]: WARNING nova.compute.manager [req-4b434158-eed5-448a-ace1-5f2996c10fd0 req-21a32298-e0ad-4fcd-b1d2-ea44e6a886c8 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received unexpected event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 for instance with vm_state building and task_state spawning.
Sep 05 00:08:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:08:58 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872523.017467, 8c80af95-ba10-4c2a-89a2-318bcfb0b13b => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:08:58 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] VM Stopped (Lifecycle Event)
Sep 05 00:08:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-649ac632-fc5b-4641-ba69-8407c9c35604 None None] [instance: 8c80af95-ba10-4c2a-89a2-318bcfb0b13b] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872539.440817, d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] VM Resumed (Lifecycle Event)
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Instance spawned successfully.
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872539.4428577, d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] VM Started (Lifecycle Event)
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Took 4.90 seconds to spawn the instance on the hypervisor.
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:08:59 user nova-compute[72954]: INFO nova.compute.manager [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Took 25.26 seconds to build instance.
Sep 05 00:08:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-e0a69710-749c-4a66-85a1-0d0c140b2feb tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.358s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:08:59 user nova-compute[72954]: DEBUG nova.compute.manager [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] No waiting events found dispatching network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:08:59 user nova-compute[72954]: WARNING nova.compute.manager [req-6c01aad7-8d24-4f8c-b8a9-f6a80a4d2738 req-5ed0d0c7-8342-484f-9e84-9739b3015194 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received unexpected event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 for instance with vm_state active and task_state None.
Sep 05 00:09:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:09:34 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:09:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:09:35 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.141983032226562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a536283b-931d-469a-9711-469f6464f9a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:09:35 user nova-compute[72954]: INFO nova.compute.claims [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Claim successful on node user
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:09:35 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:09:36 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:09:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.policy [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff61e815f67e4f509e9e33e97201759c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f019505deedc4dcba8ef93923b81c192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:09:36 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Creating image(s)
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "/opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "/opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.198s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "e9cd88272a57398eedace43da80b45f52121c8eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk 1073741824 {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb,backing_fmt=raw /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk 1073741824" returned: 0 in 0.056s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "e9cd88272a57398eedace43da80b45f52121c8eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Successfully created port: cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9cd88272a57398eedace43da80b45f52121c8eb --force-share --output=json" returned: 0 in 0.195s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk. size=1073741824 {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Sep 05 00:09:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.disk.api [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Cannot resize image /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk to a smaller size. {{(pid=72954) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Created local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Ensure instance console log exists: /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Successfully updated port: cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquired lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-changed-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Refreshing instance network info cache due to event network-changed-cc38b3ff-955e-4e0b-b630-0a1610a4f13b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] Acquiring lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.neutron [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Releasing lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Instance network_info: |[{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] Acquired lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.neutron [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Refreshing network info cache for port cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Start _get_guest_xml network_info=[{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'size': 0, 'image_id': '6cb1e7a9-0dda-46ae-bceb-c45fe69ede15'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:09:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:09:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-09-04T23:25:29Z,direct_url=<?>,disk_format='qcow2',id=6cb1e7a9-0dda-46ae-bceb-c45fe69ede15,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ec486013ab25483999e5f2ccf38b313f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-09-04T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418021708',display_name='tempest-AttachVolumeNegativeTest-server-1418021708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418021708',id=49,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHztk09twmi/YHRnLHBLARPg44N4dWSTu6r86cDrn63lbpXvByzTQBWlOkFflIWZjxKWIHGPFO4bO0UFFr1meQmibjZatI0/qI2ItfbjBVhO708dNM6L8xTN3Vi6T81FxA==',key_name='tempest-keypair-750361352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-vmkmpptu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=49b40748-33c9-4f31-9dc0-c8ea194aec0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.objects.instance [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'pci_devices' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:09:37 user nova-compute[72954]:   <uuid>49b40748-33c9-4f31-9dc0-c8ea194aec0d</uuid>
Sep 05 00:09:37 user nova-compute[72954]:   <name>instance-00000031</name>
Sep 05 00:09:37 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:09:37 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:09:37 user nova-compute[72954]:   <metadata>
Sep 05 00:09:37 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:09:37 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1418021708</nova:name>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:09:37</nova:creationTime>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:09:37 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:09:37 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:owner>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:user uuid="ff61e815f67e4f509e9e33e97201759c">tempest-AttachVolumeNegativeTest-2127434441-project-member</nova:user>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:project uuid="f019505deedc4dcba8ef93923b81c192">tempest-AttachVolumeNegativeTest-2127434441</nova:project>
Sep 05 00:09:37 user nova-compute[72954]:       </nova:owner>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:root type="image" uuid="6cb1e7a9-0dda-46ae-bceb-c45fe69ede15"/>
Sep 05 00:09:37 user nova-compute[72954]:       <nova:ports>
Sep 05 00:09:37 user nova-compute[72954]:         <nova:port uuid="cc38b3ff-955e-4e0b-b630-0a1610a4f13b">
Sep 05 00:09:37 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Sep 05 00:09:37 user nova-compute[72954]:         </nova:port>
Sep 05 00:09:37 user nova-compute[72954]:       </nova:ports>
Sep 05 00:09:37 user nova-compute[72954]:     </nova:instance>
Sep 05 00:09:37 user nova-compute[72954]:   </metadata>
Sep 05 00:09:37 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:09:37 user nova-compute[72954]:     <system>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="serial">49b40748-33c9-4f31-9dc0-c8ea194aec0d</entry>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="uuid">49b40748-33c9-4f31-9dc0-c8ea194aec0d</entry>
Sep 05 00:09:37 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:09:37 user nova-compute[72954]:     </system>
Sep 05 00:09:37 user nova-compute[72954]:   </sysinfo>
Sep 05 00:09:37 user nova-compute[72954]:   <os>
Sep 05 00:09:37 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:09:37 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:09:37 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:09:37 user nova-compute[72954]:   </os>
Sep 05 00:09:37 user nova-compute[72954]:   <features>
Sep 05 00:09:37 user nova-compute[72954]:     <acpi/>
Sep 05 00:09:37 user nova-compute[72954]:     <apic/>
Sep 05 00:09:37 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:09:37 user nova-compute[72954]:   </features>
Sep 05 00:09:37 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:09:37 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:09:37 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:09:37 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:09:37 user nova-compute[72954]:   </clock>
Sep 05 00:09:37 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:09:37 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:09:37 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:09:37 user nova-compute[72954]:   </cpu>
Sep 05 00:09:37 user nova-compute[72954]:   <devices>
Sep 05 00:09:37 user nova-compute[72954]:     <disk type="file" device="disk">
Sep 05 00:09:37 user nova-compute[72954]:       <driver name="qemu" type="qcow2" cache="none"/>
Sep 05 00:09:37 user nova-compute[72954]:       <source file="/opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk"/>
Sep 05 00:09:37 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:09:37 user nova-compute[72954]:     </disk>
Sep 05 00:09:37 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:09:37 user nova-compute[72954]:       <mac address="fa:16:3e:75:4a:f0"/>
Sep 05 00:09:37 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:09:37 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:09:37 user nova-compute[72954]:       <target dev="tapcc38b3ff-95"/>
Sep 05 00:09:37 user nova-compute[72954]:     </interface>
Sep 05 00:09:37 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:09:37 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/console.log" append="off"/>
Sep 05 00:09:37 user nova-compute[72954]:     </serial>
Sep 05 00:09:37 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:09:37 user nova-compute[72954]:     <video>
Sep 05 00:09:37 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:09:37 user nova-compute[72954]:     </video>
Sep 05 00:09:37 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:09:37 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:09:37 user nova-compute[72954]:     </rng>
Sep 05 00:09:37 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:09:37 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:09:37 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:09:37 user nova-compute[72954]:     </memballoon>
Sep 05 00:09:37 user nova-compute[72954]:   </devices>
Sep 05 00:09:37 user nova-compute[72954]: </domain>
Sep 05 00:09:37 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418021708',display_name='tempest-AttachVolumeNegativeTest-server-1418021708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418021708',id=49,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHztk09twmi/YHRnLHBLARPg44N4dWSTu6r86cDrn63lbpXvByzTQBWlOkFflIWZjxKWIHGPFO4bO0UFFr1meQmibjZatI0/qI2ItfbjBVhO708dNM6L8xTN3Vi6T81FxA==',key_name='tempest-keypair-750361352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-vmkmpptu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=49b40748-33c9-4f31-9dc0-c8ea194aec0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG os_vif [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc38b3ff-95, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc38b3ff-95, col_values=(('external_ids', {'iface-id': 'cc38b3ff-955e-4e0b-b630-0a1610a4f13b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:4a:f0', 'vm-uuid': '49b40748-33c9-4f31-9dc0-c8ea194aec0d'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:37 user nova-compute[72954]: INFO os_vif [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95')
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:09:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:75:4a:f0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:09:38 user nova-compute[72954]: DEBUG nova.network.neutron [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updated VIF entry in instance network info cache for port cc38b3ff-955e-4e0b-b630-0a1610a4f13b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:09:38 user nova-compute[72954]: DEBUG nova.network.neutron [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:09:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-04daa3d8-f6c6-4d3b-aedf-a6a542f566db req-afab234b-af0c-42d2-a24c-ba4c88cbf2e6 service nova] Releasing lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:09:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] No waiting events found dispatching network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:09:39 user nova-compute[72954]: WARNING nova.compute.manager [req-60ad7670-6c41-4b3e-9a6e-5bb0f1f8cfc6 req-fc7eb333-09bd-431a-9b36-a3283bcf0e1d service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received unexpected event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b for instance with vm_state building and task_state spawning.
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872581.365556, 49b40748-33c9-4f31-9dc0-c8ea194aec0d => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] VM Resumed (Lifecycle Event)
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Instance spawned successfully.
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872581.3663158, 49b40748-33c9-4f31-9dc0-c8ea194aec0d => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] VM Started (Lifecycle Event)
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Took 5.28 seconds to spawn the instance on the hypervisor.
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:09:41 user nova-compute[72954]: INFO nova.compute.manager [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Took 5.86 seconds to build instance.
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] No waiting events found dispatching network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:09:41 user nova-compute[72954]: WARNING nova.compute.manager [req-da557c06-1a69-4165-8f57-b645528278bf req-ef286715-c766-457a-8583-8f1018d65dc8 service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received unexpected event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b for instance with vm_state active and task_state None.
Sep 05 00:09:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-044137c3-cce5-4666-bd8c-ff5066cdc549 tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.953s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:09:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:09:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:09:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:09:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid a536283b-931d-469a-9711-469f6464f9a9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [{"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-a536283b-931d-469a-9711-469f6464f9a9" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:09:49 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:09:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:09:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:10:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-changed-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Refreshing instance network info cache due to event network-changed-1ef254ba-2ccf-4d6c-b89b-759f67bc9708. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] Acquiring lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] Acquired lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Refreshing network info cache for port 1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updated VIF entry in instance network info cache for port 1ef254ba-2ccf-4d6c-b89b-759f67bc9708. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG nova.network.neutron [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updating instance_info_cache with network_info: [{"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:10:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4748d7a2-444b-4d86-a22a-b9740d86e1d8 req-8aaa32a3-f569-4a62-9e01-0e1bba56aedb service nova] Releasing lock "refresh_cache-d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:26 user nova-compute[72954]: INFO nova.compute.manager [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Terminating instance
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Instance destroyed successfully.
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1803560913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1803560913',id=48,image_ref='545f23b4-86c9-4edb-8b33-f3fe759ae315',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHtJJJr3Jk79veTO2eerag/L9C+aKrRk1wBuh3+IU0eo9Uq5ECguxPv8hSAABVJPAarBs0TuUpMoc08LPw/oT3l9F7mO0U6BM2RF9vn2WdfBJbWcK8phzp/uxI/zoFfwg==',key_name='tempest-keypair-1682915602',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-gn5lom54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1950575880',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "address": "fa:16:3e:35:4d:cf", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ef254ba-2c", "ovs_interfaceid": "1ef254ba-2ccf-4d6c-b89b-759f67bc9708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_vif [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ef254ba-2c, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:26 user nova-compute[72954]: INFO os_vif [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:4d:cf,bridge_name='br-int',has_traffic_filtering=True,id=1ef254ba-2ccf-4d6c-b89b-759f67bc9708,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ef254ba-2c')
Sep 05 00:10:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AZONjxzk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:10:26 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2e81c7-d833-4e7e-b7e8-504c3f1a4a1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af9e72-e208-409d-bc62-612ec4640f6a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:10:26 user nova-compute[72954]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)
Sep 05 00:10:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:10:26 user nova-compute[72954]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 (non-flash)
Sep 05 00:10:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13031a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d6275-5179-462e-a06d-a59484debaf3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b89993-d091-4e50-b5b9-4acdae85c7e6]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[57943cff-a337-4ccf-8575-a45533c5f727]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:10:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c767f53d-79c7-4ec6-99a4-8f4770b8a319]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc44b4-18ce-45ce-ba08-2cbc89873954]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5520f01-4a70-4826-be9b-39eb2107fcaf]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260]
Sep 05 00:10:27 user nova-compute[72954]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3, portal: 172.16.0.220,3260] successful.
Sep 05 00:10:27 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82d79781-a743-4942-9f41-5fbd393276c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[352822df-ea77-4acf-85ac-31cdc76a8883]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (291ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:10:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Deleting instance files /opt/stack/data/nova/instances/d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3_del
Sep 05 00:10:27 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Deletion of /opt/stack/data/nova/instances/d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3_del complete
Sep 05 00:10:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:27 user nova-compute[72954]: INFO nova.compute.manager [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Took 1.16 seconds to destroy the instance on the hypervisor.
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-unplugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] No waiting events found dispatching network-vif-unplugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-unplugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Acquiring lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] No waiting events found dispatching network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:10:27 user nova-compute[72954]: WARNING nova.compute.manager [req-dea935b6-69f3-44a3-8576-9731a36745f8 req-7a55ddc7-215f-42ea-ae20-6d9ac5ef1c40 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received unexpected event network-vif-plugged-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 for instance with vm_state active and task_state deleting.
Sep 05 00:10:27 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:10:27 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Took 0.62 seconds to deallocate network for instance.
Sep 05 00:10:28 user nova-compute[72954]: INFO nova.compute.manager [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Took 0.82 seconds to detach 1 volumes for instance.
Sep 05 00:10:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Deleting volume: 82d79781-a743-4942-9f41-5fbd393276c3 {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 05 00:10:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:10:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:10:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:28 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3
Sep 05 00:10:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-8984d5d9-a1b9-427b-88c2-953cbd727a90 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.014s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-a8ce146a-c59a-4e72-b5cb-43806306e64a req-30105e16-49f1-4d60-825c-6024d984eb74 service nova] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Received event network-vif-deleted-1ef254ba-2ccf-4d6c-b89b-759f67bc9708 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:10:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:10:36 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:10:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:10:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.114723205566406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance a536283b-931d-469a-9711-469f6464f9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:10:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:10:38 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:10:38 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:10:38 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:10:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:10:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:41 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872626.7980335, d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:10:41 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] VM Stopped (Lifecycle Event)
Sep 05 00:10:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-4fb2adb7-f05f-4eb9-a707-56dad24438c4 None None] [instance: d1c7dcbf-9e3b-46fe-bbd2-80c1ee5b36e3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:10:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:10:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 05 00:10:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:10:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:11:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:08 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:08 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 05 00:11:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:11:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:21 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:24 user nova-compute[72954]: INFO nova.compute.manager [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Terminating instance
Sep 05 00:11:24 user nova-compute[72954]: DEBUG nova.compute.manager [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-unplugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] No waiting events found dispatching network-vif-unplugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.compute.manager [req-a1aa4bfc-7e8e-4474-a884-44e04ae0c5f7 req-a771c00f-223f-4ad3-b9a6-7dbe00902297 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-unplugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] Instance destroyed successfully.
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.objects.instance [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid a536283b-931d-469a-9711-469f6464f9a9 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-535289377',display_name='tempest-TestVolumeBootPattern-volume-backed-server-535289377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-535289377',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOf86vPHDFFScwmcSweHbnoAMkHGI1u68+zmizFY+KnwrBJEpfjuu17u+XCR/Edj11y3WVEL+woMKvdBZUs7fPasa4rwEttmv6qprGkBLCl3fXeMg8rMv8XC3YMowsEew==',key_name='tempest-keypair-1516749243',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:06:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-1do3mo3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=a536283b-931d-469a-9711-469f6464f9a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "address": "fa:16:3e:c1:57:95", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf043d6d0-f9", "ovs_interfaceid": "f043d6d0-f9d7-41f6-ac76-3ab6c48423cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_vif [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf043d6d0-f9, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:11:25 user nova-compute[72954]: INFO os_vif [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:57:95,bridge_name='br-int',has_traffic_filtering=True,id=f043d6d0-f9d7-41f6-ac76-3ab6c48423cb,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf043d6d0-f9')
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bOALqhoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:11:25 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f4a4c0-3821-447c-a2d4-52b948ee1313]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a0a8cb-452b-4d70-a10a-5c32a30bea89]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:11:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b (non-flash)
Sep 05 00:11:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd1302289d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d2ffc-6f24-4dc7-9e51-3b2c7a943f8e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e5f6d-d773-443f-8b15-860dc98e83f7]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[540bac8a-0c48-44d4-aa84-6d0a9a2ad3e4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc7280f-7cd2-4793-9169-c51903a87bdb]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26262646134316665', '/dev/disk/by-id/scsi-1SCST_BIO2d63b380-bbda41fe1ef0c278', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d63b380') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a534f20a-292a-45ae-8131-4b61a3e8e1ae]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e93e60-3f54-4e8e-bb6c-045e33c8b350]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[292aed05-1801-4e8b-9ea1-981c264dac93]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260]
Sep 05 00:11:25 user nova-compute[72954]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b, portal: 172.16.0.220,3260] successful.
Sep 05 00:11:25 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:418f2825-376e-4153-ba82-2e3e5ef4978b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf45476f-f2fd-4512-a3ac-3a947864972b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (291ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:11:25 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:11:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Deleting instance files /opt/stack/data/nova/instances/a536283b-931d-469a-9711-469f6464f9a9_del
Sep 05 00:11:25 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Deletion of /opt/stack/data/nova/instances/a536283b-931d-469a-9711-469f6464f9a9_del complete
Sep 05 00:11:26 user nova-compute[72954]: INFO nova.compute.manager [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Took 1.17 seconds to destroy the instance on the hypervisor.
Sep 05 00:11:26 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:11:26 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:11:26 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-changed-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Refreshing instance network info cache due to event network-changed-cc38b3ff-955e-4e0b-b630-0a1610a4f13b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] Acquiring lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] Acquired lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Refreshing network info cache for port cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:11:27 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] Took 1.06 seconds to deallocate network for instance.
Sep 05 00:11:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] Acquiring lock "a536283b-931d-469a-9711-469f6464f9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] Lock "a536283b-931d-469a-9711-469f6464f9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] No waiting events found dispatching network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:11:27 user nova-compute[72954]: WARNING nova.compute.manager [req-eb86f4f4-1d31-48eb-935a-129abb7f67f9 req-b6ba435c-711b-4965-9cf0-562a04f45125 service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received unexpected event network-vif-plugged-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb for instance with vm_state active and task_state deleting.
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updated VIF entry in instance network info cache for port cc38b3ff-955e-4e0b-b630-0a1610a4f13b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:11:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-a9291022-f421-4ad4-b040-ed02154b9f39 req-9b30d3ce-0a83-4893-8918-ce209b350d8b service nova] Releasing lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:11:27 user nova-compute[72954]: INFO nova.compute.manager [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Took 0.81 seconds to detach 1 volumes for instance.
Sep 05 00:11:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: a536283b-931d-469a-9711-469f6464f9a9] Deleting volume: 418f2825-376e-4153-ba82-2e3e5ef4978b {{(pid=72954) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Sep 05 00:11:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:11:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:11:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:28 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance a536283b-931d-469a-9711-469f6464f9a9
Sep 05 00:11:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-00c803ce-47e4-406e-991f-9b3cf1a1d7f7 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "a536283b-931d-469a-9711-469f6464f9a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.576s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-e3088f83-cb2d-4744-9a65-e62f0e14993d req-92388c70-38af-423d-800d-ee14998dbaeb service nova] [instance: a536283b-931d-469a-9711-469f6464f9a9] Received event network-vif-deleted-f043d6d0-f9d7-41f6-ac76-3ab6c48423cb {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:11:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:32 user nova-compute[72954]: INFO nova.compute.manager [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Attaching volume 5a241ac2-bc56-4a50-871b-4f8c577ca8f2 to /dev/vdb
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.utils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[be79ba80-dbb5-44a9-ad1c-5fcb6702f33c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b98c63b-5fba-4200-970d-d75a49e1ffcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a098d-02bb-42b8-a241-af240bd71f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c045d7-9563-4dac-b4ff-02e17b958e53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:11:32 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:11:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2689c-f345-4634-aaeb-7f31a0133de2]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG os_brick.utils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:11:32 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating existing volume attachment record: 522f8fdf-68fb-4dee-a2d7-0adb3974fbcc {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:11:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:36 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:36 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:36 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:11:37 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:11:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=25.11355972290039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:11:37 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:11:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:40 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872685.6337447, a536283b-931d-469a-9711-469f6464f9a9 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:11:40 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: a536283b-931d-469a-9711-469f6464f9a9] VM Stopped (Lifecycle Event)
Sep 05 00:11:40 user nova-compute[72954]: DEBUG nova.compute.manager [None req-cc939c19-4048-40d3-a4ba-a61c905a0790 None None] [instance: a536283b-931d-469a-9711-469f6464f9a9] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:11:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:41 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQawAxdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:11:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:11:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:11:45 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb428d14-0b50-4095-a9fc-84bec2a8f345]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:11:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb9364-b411-420e-834d-0dafdc50c849]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2] added
Sep 05 00:11:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1788786-ab26-4acf-89e2-e0976f91169f]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ed2ba-f676-463a-aead-e3c9026ba7d6]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQawAxdE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQawAxdE" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb359d49-3eb0-441f-833c-0274ce11474b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mQawAxdE'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e04cb9f-d6fd-49d2-b5d6-d89bf67cb5f0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[744152e7-8677-4206-a25a-e75cf6bee31c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:11:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:11:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:11:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 05 00:11:45 user nova-compute[72954]: 
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe535b6b-de58-443a-9dd5-ec1faba042fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260]
Sep 05 00:11:45 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260] successful.
Sep 05 00:11:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3340d20d-e77d-41ae-8bc5-2d6839b88a2d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f492f6-851b-46f5-84af-8d4d2909d457]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)
Sep 05 00:11:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)
Sep 05 00:11:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[10263e83-dfd3-4547-b7ef-ba694beed920]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:11:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQawAxdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26236663638313331', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236663638313331', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:11:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] attach device xml: <disk type="block" device="disk">
Sep 05 00:11:46 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:11:46 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:11:46 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:11:46 user nova-compute[72954]:   <serial>5a241ac2-bc56-4a50-871b-4f8c577ca8f2</serial>
Sep 05 00:11:46 user nova-compute[72954]: </disk>
Sep 05 00:11:46 user nova-compute[72954]:  {{(pid=72954) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Sep 05 00:11:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:11:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:11:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] No VIF found with MAC fa:16:3e:75:4a:f0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:11:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-b6d70719-41a0-4211-a1cd-dc84fb530d4d tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.308s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:11:48 user nova-compute[72954]: INFO nova.compute.manager [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Detaching volume 5a241ac2-bc56-4a50-871b-4f8c577ca8f2
Sep 05 00:11:48 user nova-compute[72954]: INFO nova.virt.block_device [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Attempting to driver detach volume 5a241ac2-bc56-4a50-871b-4f8c577ca8f2 from mountpoint /dev/vdb
Sep 05 00:11:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Attempting to detach device vdb from instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d from the persistent domain config. {{(pid=72954) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:11:48 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:11:48 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:11:48 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:11:48 user nova-compute[72954]:   <serial>5a241ac2-bc56-4a50-871b-4f8c577ca8f2</serial>
Sep 05 00:11:48 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:11:48 user nova-compute[72954]: </disk>
Sep 05 00:11:48 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:11:48 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d from the persistent domain config.
Sep 05 00:11:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d from the live domain config. {{(pid=72954) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG nova.virt.libvirt.guest [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] detach device xml: <disk type="block" device="disk">
Sep 05 00:11:48 user nova-compute[72954]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:11:48 user nova-compute[72954]:   <source dev="/dev/sdb"/>
Sep 05 00:11:48 user nova-compute[72954]:   <target dev="vdb" bus="virtio"/>
Sep 05 00:11:48 user nova-compute[72954]:   <serial>5a241ac2-bc56-4a50-871b-4f8c577ca8f2</serial>
Sep 05 00:11:48 user nova-compute[72954]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Sep 05 00:11:48 user nova-compute[72954]: </disk>
Sep 05 00:11:48 user nova-compute[72954]:  {{(pid=72954) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Received event <DeviceRemovedEvent: 1693872709.3415852, 49b40748-33c9-4f31-9dc0-c8ea194aec0d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72954) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2370}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Sep 05 00:11:49 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully detached device vdb from instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d from the live domain config.
Sep 05 00:11:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQawAxdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:11:49 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42edc78-b685-4c86-b8d4-bd53d31fd53c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2d1f53-99c0-4508-a296-9a580670c75a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)
Sep 05 00:11:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 (non-flash)
Sep 05 00:11:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd11836b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700e89f-6fa3-40e4-b06e-902043e1108a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc7f97-5339-488c-8e06-229a5b688884]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c898e-db31-4f9e-9e62-cd74a90fb822]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[170156dc-cb81-48f4-8c80-271f8dec473a]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8cc26c-269e-4786-827e-9ac522dd22a8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fedda5c-64cf-49d8-9148-aaef32b6bbf5]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260]
Sep 05 00:11:49 user nova-compute[72954]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2, portal: 172.16.0.220,3260] successful.
Sep 05 00:11:49 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a241ac2-bc56-4a50-871b-4f8c577ca8f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc64deb-6ff5-4c52-b804-e295cd2fc901]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] <== disconnect_volume: return (251ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:50 user nova-compute[72954]: DEBUG nova.objects.instance [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'flavor' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:11:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-cbf37fd5-2d7f-4a40-a378-56eab833188a tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.723s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:11:50 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:11:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:11:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:11:51 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [{"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-49b40748-33c9-4f31-9dc0-c8ea194aec0d" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:11:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:11:55 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:00 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:05 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:10 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:15 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:12:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:12:31 user nova-compute[72954]: INFO nova.compute.claims [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Claim successful on node user
Sep 05 00:12:31 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:12:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:12:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:12:32 user nova-compute[72954]: INFO nova.virt.block_device [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Booting with volume 414f99c3-e370-4417-b734-8093c5312973 at /dev/vda
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.policy [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.utils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbaa56a-4f1f-4dba-aea9-cdd1300df0df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ac1ddb-c15c-45fd-ad29-60e2d9509961]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c723bee-d9bf-440d-bfb3-d5dc0272d661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[072441bb-c025-4deb-a682-e9efe82ad4c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:12:32 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:12:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6f83e-6b16-454f-acb0-ac323be6c1c7]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG os_brick.utils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating existing volume attachment record: 311082c8-5db6-40e2-936f-e5b722511e95 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:12:32 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Successfully created port: ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Successfully updated port: ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-changed-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.compute.manager [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Refreshing instance network info cache due to event network-changed-ba8b4c86-6718-4838-819e-4942af099d9e. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] Acquiring lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.network.neutron [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Instance network_info: |[{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] Acquired lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:12:33 user nova-compute[72954]: DEBUG nova.network.neutron [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Refreshing network info cache for port ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:12:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updated VIF entry in instance network info cache for port ba8b4c86-6718-4838-819e-4942af099d9e. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:12:34 user nova-compute[72954]: DEBUG nova.network.neutron [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:12:34 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-100ffe48-f7d9-49ee-9ff5-da9e31c3e843 req-f8d31c25-1137-45de-8e9d-d9d25c422e20 service nova] Releasing lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:12:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:12:38 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:39 user nova-compute[72954]: INFO nova.compute.manager [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Terminating instance
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.manager [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-unplugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] No waiting events found dispatching network-vif-unplugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.manager [req-39a627be-8fe8-40e9-859c-23c899a79bd0 req-0a001c5d-db10-49f2-95ec-3eb182ab9fdc service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-unplugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:12:39 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:12:39 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.111827850341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Instance destroyed successfully.
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.objects.instance [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lazy-loading 'resources' on Instance uuid 49b40748-33c9-4f31-9dc0-c8ea194aec0d {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 38e2bcdf-075a-4fdb-a210-2ac246785ac5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418021708',display_name='tempest-AttachVolumeNegativeTest-server-1418021708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418021708',id=49,image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHztk09twmi/YHRnLHBLARPg44N4dWSTu6r86cDrn63lbpXvByzTQBWlOkFflIWZjxKWIHGPFO4bO0UFFr1meQmibjZatI0/qI2ItfbjBVhO708dNM6L8xTN3Vi6T81FxA==',key_name='tempest-keypair-750361352',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f019505deedc4dcba8ef93923b81c192',ramdisk_id='',reservation_id='r-vmkmpptu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6cb1e7a9-0dda-46ae-bceb-c45fe69ede15',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2127434441',owner_user_name='tempest-AttachVolumeNegativeTest-2127434441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff61e815f67e4f509e9e33e97201759c',uuid=49b40748-33c9-4f31-9dc0-c8ea194aec0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converting VIF {"id": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "address": "fa:16:3e:75:4a:f0", "network": {"id": "269fdc6c-9e47-4d4b-a4d4-94a757102b32", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-820839834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f019505deedc4dcba8ef93923b81c192", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc38b3ff-95", "ovs_interfaceid": "cc38b3ff-955e-4e0b-b630-0a1610a4f13b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG os_vif [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc38b3ff-95, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:39 user nova-compute[72954]: INFO os_vif [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:4a:f0,bridge_name='br-int',has_traffic_filtering=True,id=cc38b3ff-955e-4e0b-b630-0a1610a4f13b,network=Network(269fdc6c-9e47-4d4b-a4d4-94a757102b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc38b3ff-95')
Sep 05 00:12:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Deleting instance files /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d_del
Sep 05 00:12:39 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Deletion of /opt/stack/data/nova/instances/49b40748-33c9-4f31-9dc0-c8ea194aec0d_del complete
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:12:39 user nova-compute[72954]: INFO nova.compute.manager [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Took 0.86 seconds to destroy the instance on the hypervisor.
Sep 05 00:12:39 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:12:39 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:12:40 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Took 0.78 seconds to deallocate network for instance.
Sep 05 00:12:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:12:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:40 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Deleted allocations for instance 49b40748-33c9-4f31-9dc0-c8ea194aec0d
Sep 05 00:12:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-6c28ab9b-b39c-404a-9fa6-80349451e89b tempest-AttachVolumeNegativeTest-2127434441 tempest-AttachVolumeNegativeTest-2127434441-project-member] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.956s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] Acquiring lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] Lock "49b40748-33c9-4f31-9dc0-c8ea194aec0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] No waiting events found dispatching network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:12:41 user nova-compute[72954]: WARNING nova.compute.manager [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received unexpected event network-vif-plugged-cc38b3ff-955e-4e0b-b630-0a1610a4f13b for instance with vm_state deleted and task_state None.
Sep 05 00:12:41 user nova-compute[72954]: DEBUG nova.compute.manager [req-9294a392-feb3-4d92-b6df-e1cb0c6f2372 req-233175ba-4e0b-49f0-92bd-eab934fc468a service nova] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Received event network-vif-deleted-cc38b3ff-955e-4e0b-b630-0a1610a4f13b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:43 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:12:45 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Creating image(s)
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Ensure instance console log exists: /opt/stack/data/nova/instances/38e2bcdf-075a-4fdb-a210-2ac246785ac5/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Start _get_guest_xml network_info=[{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38e2bcdf-075a-4fdb-a210-2ac246785ac5', 'attached_at': '', 'detached_at': '', 'volume_id': '414f99c3-e370-4417-b734-8093c5312973', 'serial': '414f99c3-e370-4417-b734-8093c5312973'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '311082c8-5db6-40e2-936f-e5b722511e95', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:12:45 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:12:45 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:12:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:12:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:12:45 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d4739-73e0-4e8f-b7e0-55789040ab2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:12:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa219ce-4163-4cfe-b3a0-47c4e92be1ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973] added
Sep 05 00:12:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9028bc-34c9-465e-8359-0da20a4bc1d0]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0604833-9aed-4f06-a25d-72a1724da4a4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRTBHipJ {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRTBHipJ" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fecaab-714e-4b1f-8e30-864a9ea65a76]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRTBHipJ'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[777c05cd-a7da-4b2f-95d2-c96ffb1780ec]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341884a-fd61-49d9-84c3-66fe4f791a4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:12:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:12:45 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:12:45 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 05 00:12:45 user nova-compute[72954]: 
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb13bc-1e17-4134-a7c3-a86855905ee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]
Sep 05 00:12:45 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.
Sep 05 00:12:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33b2ba5-022e-4d7f-baac-7c581956376e]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e114532-3093-4579-b57e-6ec92ab22790]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:12:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:12:45 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a2845-36bf-4c5c-ac4c-04ffd62b6112]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:12:45 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26362663334323230', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663334323230', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2122685801',display_name='tempest-TestVolumeBootPattern-server-2122685801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2122685801',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-0gprs446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:12:32Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=38e2bcdf-075a-4fdb-a210-2ac246785ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.objects.instance [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid 38e2bcdf-075a-4fdb-a210-2ac246785ac5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:12:46 user nova-compute[72954]:   <uuid>38e2bcdf-075a-4fdb-a210-2ac246785ac5</uuid>
Sep 05 00:12:46 user nova-compute[72954]:   <name>instance-00000032</name>
Sep 05 00:12:46 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:12:46 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:12:46 user nova-compute[72954]:   <metadata>
Sep 05 00:12:46 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:12:46 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:12:46 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-server-2122685801</nova:name>
Sep 05 00:12:46 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:12:45</nova:creationTime>
Sep 05 00:12:46 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:12:46 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:12:46 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:12:46 user nova-compute[72954]:       <nova:owner>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:12:46 user nova-compute[72954]:       </nova:owner>
Sep 05 00:12:46 user nova-compute[72954]:       <nova:ports>
Sep 05 00:12:46 user nova-compute[72954]:         <nova:port uuid="ba8b4c86-6718-4838-819e-4942af099d9e">
Sep 05 00:12:46 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 05 00:12:46 user nova-compute[72954]:         </nova:port>
Sep 05 00:12:46 user nova-compute[72954]:       </nova:ports>
Sep 05 00:12:46 user nova-compute[72954]:     </nova:instance>
Sep 05 00:12:46 user nova-compute[72954]:   </metadata>
Sep 05 00:12:46 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:12:46 user nova-compute[72954]:     <system>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="serial">38e2bcdf-075a-4fdb-a210-2ac246785ac5</entry>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="uuid">38e2bcdf-075a-4fdb-a210-2ac246785ac5</entry>
Sep 05 00:12:46 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:12:46 user nova-compute[72954]:     </system>
Sep 05 00:12:46 user nova-compute[72954]:   </sysinfo>
Sep 05 00:12:46 user nova-compute[72954]:   <os>
Sep 05 00:12:46 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:12:46 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:12:46 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:12:46 user nova-compute[72954]:   </os>
Sep 05 00:12:46 user nova-compute[72954]:   <features>
Sep 05 00:12:46 user nova-compute[72954]:     <acpi/>
Sep 05 00:12:46 user nova-compute[72954]:     <apic/>
Sep 05 00:12:46 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:12:46 user nova-compute[72954]:   </features>
Sep 05 00:12:46 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:12:46 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:12:46 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:12:46 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:12:46 user nova-compute[72954]:   </clock>
Sep 05 00:12:46 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:12:46 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:12:46 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:12:46 user nova-compute[72954]:   </cpu>
Sep 05 00:12:46 user nova-compute[72954]:   <devices>
Sep 05 00:12:46 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:12:46 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:12:46 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 05 00:12:46 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:12:46 user nova-compute[72954]:       <serial>414f99c3-e370-4417-b734-8093c5312973</serial>
Sep 05 00:12:46 user nova-compute[72954]:     </disk>
Sep 05 00:12:46 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:12:46 user nova-compute[72954]:       <mac address="fa:16:3e:ed:c6:a9"/>
Sep 05 00:12:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:12:46 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:12:46 user nova-compute[72954]:       <target dev="tapba8b4c86-67"/>
Sep 05 00:12:46 user nova-compute[72954]:     </interface>
Sep 05 00:12:46 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:12:46 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/38e2bcdf-075a-4fdb-a210-2ac246785ac5/console.log" append="off"/>
Sep 05 00:12:46 user nova-compute[72954]:     </serial>
Sep 05 00:12:46 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:12:46 user nova-compute[72954]:     <video>
Sep 05 00:12:46 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:12:46 user nova-compute[72954]:     </video>
Sep 05 00:12:46 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:12:46 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:12:46 user nova-compute[72954]:     </rng>
Sep 05 00:12:46 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:12:46 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:12:46 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:12:46 user nova-compute[72954]:     </memballoon>
Sep 05 00:12:46 user nova-compute[72954]:   </devices>
Sep 05 00:12:46 user nova-compute[72954]: </domain>
Sep 05 00:12:46 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2122685801',display_name='tempest-TestVolumeBootPattern-server-2122685801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2122685801',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-0gprs446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:12:32Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=38e2bcdf-075a-4fdb-a210-2ac246785ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG os_vif [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba8b4c86-67, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba8b4c86-67, col_values=(('external_ids', {'iface-id': 'ba8b4c86-6718-4838-819e-4942af099d9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:c6:a9', 'vm-uuid': '38e2bcdf-075a-4fdb-a210-2ac246785ac5'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:46 user nova-compute[72954]: INFO os_vif [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67')
Sep 05 00:12:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:12:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:ed:c6:a9, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:12:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG nova.compute.manager [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] No waiting events found dispatching network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:12:48 user nova-compute[72954]: WARNING nova.compute.manager [req-290bfcbe-af91-4573-ae36-9ea361fa686c req-2cdda0ca-1d76-4fa6-9d7c-8ca1c4847123 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received unexpected event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e for instance with vm_state building and task_state spawning.
Sep 05 00:12:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872770.4888363, 38e2bcdf-075a-4fdb-a210-2ac246785ac5 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] VM Resumed (Lifecycle Event)
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Instance spawned successfully.
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872770.4904318, 38e2bcdf-075a-4fdb-a210-2ac246785ac5 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] VM Started (Lifecycle Event)
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] No waiting events found dispatching network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:12:50 user nova-compute[72954]: WARNING nova.compute.manager [req-9284aed6-e835-4bdd-8f5f-6c9ef9b6afc3 req-1fc4f8e8-5fe0-4485-85c6-38ff52f0f93e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received unexpected event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e for instance with vm_state building and task_state spawning.
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Took 5.19 seconds to spawn the instance on the hypervisor.
Sep 05 00:12:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:12:50 user nova-compute[72954]: INFO nova.compute.manager [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Took 19.03 seconds to build instance.
Sep 05 00:12:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-aeb46ec7-9ef2-4ba9-bcf7-279ced9a4682 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.160s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:12:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:12:52 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 38e2bcdf-075a-4fdb-a210-2ac246785ac5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:12:53 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:12:53 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:12:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:12:54 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872759.8457413, 49b40748-33c9-4f31-9dc0-c8ea194aec0d => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:12:54 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] VM Stopped (Lifecycle Event)
Sep 05 00:12:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f2f1e050-47f2-4e96-89d2-5a59a8b89201 None None] [instance: 49b40748-33c9-4f31-9dc0-c8ea194aec0d] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:12:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:13:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:13:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:13:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.13800048828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance 38e2bcdf-075a-4fdb-a210-2ac246785ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:13:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:13:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:13:54 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid 38e2bcdf-075a-4fdb-a210-2ac246785ac5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:13:55 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:13:55 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:13:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:13:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:13:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:14:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:14:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-changed-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:14:23 user nova-compute[72954]: DEBUG nova.compute.manager [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Refreshing instance network info cache due to event network-changed-ba8b4c86-6718-4838-819e-4942af099d9e. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:14:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] Acquiring lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:14:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] Acquired lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:14:23 user nova-compute[72954]: DEBUG nova.network.neutron [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Refreshing network info cache for port ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:14:24 user nova-compute[72954]: DEBUG nova.network.neutron [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updated VIF entry in instance network info cache for port ba8b4c86-6718-4838-819e-4942af099d9e. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:14:24 user nova-compute[72954]: DEBUG nova.network.neutron [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [{"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:14:24 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-1d51bfcf-d490-4823-ae5e-f3fd894d05e7 req-4faa807f-ba93-4428-a77f-44593e66e30a service nova] Releasing lock "refresh_cache-38e2bcdf-075a-4fdb-a210-2ac246785ac5" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:25 user nova-compute[72954]: INFO nova.compute.manager [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Terminating instance
Sep 05 00:14:25 user nova-compute[72954]: DEBUG nova.compute.manager [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:25 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-unplugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] No waiting events found dispatching network-vif-unplugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.compute.manager [req-d8eda321-f74d-4b95-a5dd-936480f1b735 req-fa9206c2-c085-439b-9b01-df379f48bda4 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-unplugged-ba8b4c86-6718-4838-819e-4942af099d9e for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:14:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Instance destroyed successfully.
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.objects.instance [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid 38e2bcdf-075a-4fdb-a210-2ac246785ac5 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2122685801',display_name='tempest-TestVolumeBootPattern-server-2122685801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2122685801',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-0gprs446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:12:51Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=38e2bcdf-075a-4fdb-a210-2ac246785ac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "ba8b4c86-6718-4838-819e-4942af099d9e", "address": "fa:16:3e:ed:c6:a9", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba8b4c86-67", "ovs_interfaceid": "ba8b4c86-6718-4838-819e-4942af099d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_vif [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba8b4c86-67, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:26 user nova-compute[72954]: INFO os_vif [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c6:a9,bridge_name='br-int',has_traffic_filtering=True,id=ba8b4c86-6718-4838-819e-4942af099d9e,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba8b4c86-67')
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:14:26 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc92868d-5e7a-438b-9716-dc38d09772e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[86acd341-a63e-4808-b4e0-18bccdbcf5eb]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:14:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:14:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118157d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9adb7a-d11c-4627-8aae-9542e20c87d8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8926d83-e4f5-4e1f-a81b-3a707be90db1]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a334e-f043-480e-a2d7-9f5c8018ec20]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[39643739-d03c-4e25-9c59-38998410dfbe]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26362663334323230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9ea9435f', '/dev/disk/by-id/scsi-1SCST_BIO9ea9435f-cbf34220ff12eddf') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[21353185-ab63-47ef-8faf-d892a9989de2]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee29813-283e-49fd-af12-cd7800b041bd]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54de1bd-0509-40ff-8f9a-0c4529a10695]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]
Sep 05 00:14:26 user nova-compute[72954]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.
Sep 05 00:14:26 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f37931-7c6a-4296-b32d-fd443bfc0822]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (307ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:14:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Deleting instance files /opt/stack/data/nova/instances/38e2bcdf-075a-4fdb-a210-2ac246785ac5_del
Sep 05 00:14:26 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Deletion of /opt/stack/data/nova/instances/38e2bcdf-075a-4fdb-a210-2ac246785ac5_del complete
Sep 05 00:14:26 user nova-compute[72954]: INFO nova.compute.manager [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Took 1.22 seconds to destroy the instance on the hypervisor.
Sep 05 00:14:26 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:14:26 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:14:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:27 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:14:27 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Took 0.73 seconds to deallocate network for instance.
Sep 05 00:14:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa0a6f64-227f-48c9-8bb2-5f873193e2e9 req-ea3cc072-993a-4607-af02-d9e62af9500e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-deleted-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:14:27 user nova-compute[72954]: INFO nova.compute.manager [req-fa0a6f64-227f-48c9-8bb2-5f873193e2e9 req-ea3cc072-993a-4607-af02-d9e62af9500e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Neutron deleted interface ba8b4c86-6718-4838-819e-4942af099d9e; detaching it from the instance and deleting it from the info cache
Sep 05 00:14:27 user nova-compute[72954]: DEBUG nova.network.neutron [req-fa0a6f64-227f-48c9-8bb2-5f873193e2e9 req-ea3cc072-993a-4607-af02-d9e62af9500e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:14:27 user nova-compute[72954]: DEBUG nova.compute.manager [req-fa0a6f64-227f-48c9-8bb2-5f873193e2e9 req-ea3cc072-993a-4607-af02-d9e62af9500e service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Detach interface failed, port_id=ba8b4c86-6718-4838-819e-4942af099d9e, reason: Instance 38e2bcdf-075a-4fdb-a210-2ac246785ac5 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] Acquiring lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] No waiting events found dispatching network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:14:28 user nova-compute[72954]: WARNING nova.compute.manager [req-0f224a33-a86a-4ed6-9c09-8d7907c8f969 req-03fb7771-d76f-4487-8a8b-12c37ebfcc00 service nova] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Received unexpected event network-vif-plugged-ba8b4c86-6718-4838-819e-4942af099d9e for instance with vm_state active and task_state deleting.
Sep 05 00:14:28 user nova-compute[72954]: INFO nova.compute.manager [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Took 0.83 seconds to detach 1 volumes for instance.
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:28 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance 38e2bcdf-075a-4fdb-a210-2ac246785ac5
Sep 05 00:14:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-4d8eb635-92e1-4f4f-97f2-66a1a4ec5451 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "38e2bcdf-075a-4fdb-a210-2ac246785ac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.126s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:14:40 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693872866.2567475, 38e2bcdf-075a-4fdb-a210-2ac246785ac5 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:14:41 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] VM Stopped (Lifecycle Event)
Sep 05 00:14:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:14:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.136070251464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.manager [None req-dd37b25c-c22a-4edb-9760-b2f87c6a86ec None None] [instance: 38e2bcdf-075a-4fdb-a210-2ac246785ac5] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:14:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:14:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:14:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:48 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:48 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:14:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:14:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:14:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:14:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:14:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 05 00:14:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:15:17 user nova-compute[72954]: INFO nova.compute.claims [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Claim successful on node user
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:15:17 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:15:17 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:15:18 user nova-compute[72954]: INFO nova.virt.block_device [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Booting with volume 414f99c3-e370-4417-b734-8093c5312973 at /dev/vda
Sep 05 00:15:18 user nova-compute[72954]: DEBUG nova.policy [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.utils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c310c5-35e9-45ff-95e1-42c03e6e06f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9390b9-8b83-41b2-b240-3b03cb3dd36f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0005ae43-bbf2-4144-858f-e44b927defe4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed1ed7-4cde-48aa-ba6d-9778162f5028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:15:18 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:15:18 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[310b6c76-bda6-4b9c-be15-f113a033c210]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG os_brick.utils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating existing volume attachment record: be9c1404-66bf-4dbb-974c-caaa0de200eb {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:15:18 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Successfully created port: b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Successfully updated port: b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing instance network info cache due to event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.network.neutron [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Instance network_info: |[{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:15:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:15:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated VIF entry in instance network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:15:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:15:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-22d3f9a3-0ad6-4fa2-972a-3786fcdb85bd req-a1d5d6a1-38c8-4eb8-8559-91ad40de771e service nova] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:15:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:15:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:15:32 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Creating image(s)
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e394265d-c884-487b-80a3-8a99ed1362c3/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Start _get_guest_xml network_info=[{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e394265d-c884-487b-80a3-8a99ed1362c3', 'attached_at': '', 'detached_at': '', 'volume_id': '414f99c3-e370-4417-b734-8093c5312973', 'serial': '414f99c3-e370-4417-b734-8093c5312973'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'be9c1404-66bf-4dbb-974c-caaa0de200eb', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:15:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:15:32 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:15:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:15:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:15:32 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2172b7-7cd5-49b6-a90e-e4164bc7548e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:15:32 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a393de-945b-4fb2-98b9-029889ee26a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973] added
Sep 05 00:15:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e0b9a-6c65-4f1d-96de-f10eabe29f45]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b87fc-2b91-4920-8e69-1d1fc1fb2ab4]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRTBHipJ {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRTBHipJ" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d4a87-eee4-4957-b8c8-f780ea1dc88b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRTBHipJ'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e36e1aa-0e33-4e28-8b30-140f1e19ba55]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff792e4-45ca-4067-9698-be054e80e9d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:15:32 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Sep 05 00:15:32 user nova-compute[72954]:  {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:15:32 user nova-compute[72954]: WARNING os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Sep 05 00:15:32 user nova-compute[72954]: 
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf28f6-f9f4-4a61-94d5-ffadd4e17b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]
Sep 05 00:15:32 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.
Sep 05 00:15:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[74898614-cec1-432c-8ff2-2198bd551521]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7948212-eccb-4c43-8adf-38c3815623db]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:15:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:15:32 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1c1e3-e71d-4673-a033-75cb52b19df4]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:15:32 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26362663334323230', 'path': '/dev/sdb'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663334323230', 'path': '/dev/sdb'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382327239',display_name='tempest-TestVolumeBootPattern-server-1382327239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382327239',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-n0pfv06b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:15:18Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=e394265d-c884-487b-80a3-8a99ed1362c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.objects.instance [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:15:33 user nova-compute[72954]:   <uuid>e394265d-c884-487b-80a3-8a99ed1362c3</uuid>
Sep 05 00:15:33 user nova-compute[72954]:   <name>instance-00000033</name>
Sep 05 00:15:33 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:15:33 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:15:33 user nova-compute[72954]:   <metadata>
Sep 05 00:15:33 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:15:33 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:15:33 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-server-1382327239</nova:name>
Sep 05 00:15:33 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:15:32</nova:creationTime>
Sep 05 00:15:33 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:15:33 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:15:33 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:15:33 user nova-compute[72954]:       <nova:owner>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:15:33 user nova-compute[72954]:       </nova:owner>
Sep 05 00:15:33 user nova-compute[72954]:       <nova:ports>
Sep 05 00:15:33 user nova-compute[72954]:         <nova:port uuid="b0d4fb51-edaa-4285-9229-279bafddc7b7">
Sep 05 00:15:33 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Sep 05 00:15:33 user nova-compute[72954]:         </nova:port>
Sep 05 00:15:33 user nova-compute[72954]:       </nova:ports>
Sep 05 00:15:33 user nova-compute[72954]:     </nova:instance>
Sep 05 00:15:33 user nova-compute[72954]:   </metadata>
Sep 05 00:15:33 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:15:33 user nova-compute[72954]:     <system>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="serial">e394265d-c884-487b-80a3-8a99ed1362c3</entry>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="uuid">e394265d-c884-487b-80a3-8a99ed1362c3</entry>
Sep 05 00:15:33 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:15:33 user nova-compute[72954]:     </system>
Sep 05 00:15:33 user nova-compute[72954]:   </sysinfo>
Sep 05 00:15:33 user nova-compute[72954]:   <os>
Sep 05 00:15:33 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:15:33 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:15:33 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:15:33 user nova-compute[72954]:   </os>
Sep 05 00:15:33 user nova-compute[72954]:   <features>
Sep 05 00:15:33 user nova-compute[72954]:     <acpi/>
Sep 05 00:15:33 user nova-compute[72954]:     <apic/>
Sep 05 00:15:33 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:15:33 user nova-compute[72954]:   </features>
Sep 05 00:15:33 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:15:33 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:15:33 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:15:33 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:15:33 user nova-compute[72954]:   </clock>
Sep 05 00:15:33 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:15:33 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:15:33 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:15:33 user nova-compute[72954]:   </cpu>
Sep 05 00:15:33 user nova-compute[72954]:   <devices>
Sep 05 00:15:33 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:15:33 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:15:33 user nova-compute[72954]:       <source dev="/dev/sdb"/>
Sep 05 00:15:33 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:15:33 user nova-compute[72954]:       <serial>414f99c3-e370-4417-b734-8093c5312973</serial>
Sep 05 00:15:33 user nova-compute[72954]:     </disk>
Sep 05 00:15:33 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:15:33 user nova-compute[72954]:       <mac address="fa:16:3e:35:a7:39"/>
Sep 05 00:15:33 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:15:33 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:15:33 user nova-compute[72954]:       <target dev="tapb0d4fb51-ed"/>
Sep 05 00:15:33 user nova-compute[72954]:     </interface>
Sep 05 00:15:33 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:15:33 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/e394265d-c884-487b-80a3-8a99ed1362c3/console.log" append="off"/>
Sep 05 00:15:33 user nova-compute[72954]:     </serial>
Sep 05 00:15:33 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:15:33 user nova-compute[72954]:     <video>
Sep 05 00:15:33 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:15:33 user nova-compute[72954]:     </video>
Sep 05 00:15:33 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:15:33 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:15:33 user nova-compute[72954]:     </rng>
Sep 05 00:15:33 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:15:33 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:15:33 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:15:33 user nova-compute[72954]:     </memballoon>
Sep 05 00:15:33 user nova-compute[72954]:   </devices>
Sep 05 00:15:33 user nova-compute[72954]: </domain>
Sep 05 00:15:33 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382327239',display_name='tempest-TestVolumeBootPattern-server-1382327239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382327239',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-n0pfv06b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:15:18Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=e394265d-c884-487b-80a3-8a99ed1362c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG os_vif [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0d4fb51-ed, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0d4fb51-ed, col_values=(('external_ids', {'iface-id': 'b0d4fb51-edaa-4285-9229-279bafddc7b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:a7:39', 'vm-uuid': 'e394265d-c884-487b-80a3-8a99ed1362c3'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:33 user nova-compute[72954]: INFO os_vif [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed')
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:15:33 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:35:a7:39, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG nova.compute.manager [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] No waiting events found dispatching network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:15:35 user nova-compute[72954]: WARNING nova.compute.manager [req-5e2e3506-b183-46fd-95a3-4760082f6383 req-070118f7-1145-4e33-847a-017144e0d493 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received unexpected event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 for instance with vm_state building and task_state spawning.
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:35 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872937.3983355, e394265d-c884-487b-80a3-8a99ed1362c3 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] VM Resumed (Lifecycle Event)
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Instance spawned successfully.
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693872937.404814, e394265d-c884-487b-80a3-8a99ed1362c3 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] VM Started (Lifecycle Event)
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Took 5.05 seconds to spawn the instance on the hypervisor.
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:15:37 user nova-compute[72954]: INFO nova.compute.manager [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Took 20.07 seconds to build instance.
Sep 05 00:15:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-70913d7d-9235-428f-9f25-37f9e8cfb9b9 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.187s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:37 user nova-compute[72954]: DEBUG nova.compute.manager [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] No waiting events found dispatching network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:15:37 user nova-compute[72954]: WARNING nova.compute.manager [req-f435ecfe-3c8d-4da4-9096-a4e03cf9f3e9 req-c493b0f9-25f8-4f90-a43e-5fb3fcc4c99f service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received unexpected event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 for instance with vm_state active and task_state None.
Sep 05 00:15:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:15:40 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:15:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:15:41 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.12542724609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e394265d-c884-487b-80a3-8a99ed1362c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:15:41 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:15:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:15:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:47 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:15:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:15:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:52 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 05 00:15:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 05 00:15:56 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:15:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:15:56 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:15:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:15:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:14 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:14 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 05 00:16:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:16:31 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:16:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:16:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:16:43 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:16:43 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.124099731445312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e394265d-c884-487b-80a3-8a99ed1362c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:16:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:16:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:49 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:50 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Triggering sync for uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10315}}
Sep 05 00:16:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:16:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:16:50 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:16:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:52 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:16:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:16:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:55 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:16:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:16:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:16:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:16:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:17:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG nova.compute.manager [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing instance network info cache due to event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated VIF entry in instance network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG nova.network.neutron [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:17:09 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-2bca1edb-fb5f-466e-9f99-434d7ccb2549 req-449904ec-a707-4665-8a84-05c1f217d3c7 service nova] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:17:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Starting instance... {{(pid=72954) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:27 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72954) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Sep 05 00:17:27 user nova-compute[72954]: INFO nova.compute.claims [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Claim successful on node user
Sep 05 00:17:27 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Start building networks asynchronously for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Allocating IP information in the background. {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] allocate_for_instance() {{(pid=72954) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Sep 05 00:17:28 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Start building block device mappings for instance. {{(pid=72954) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.policy [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3cf7d858403844ce8f360f40e57ac51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '976fc195b97d48a58066e69ccfd0598f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72954) authorize /opt/stack/nova/nova/policy.py:203}}
Sep 05 00:17:28 user nova-compute[72954]: INFO nova.virt.block_device [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Booting with volume 9399929d-fa82-406f-a797-d5a0ba3209fb at /dev/vda
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28327b-81c5-4ca4-b16f-9aa37d9b4187]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:77a24c62647a\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff2bc7-e161-4fef-b806-a392dee6d487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[293fd449-6226-4307-8de4-4ef70ee76944]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[401bd148-17e1-4222-a292-2c5f07916488]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Running cmd (subprocess): nvme version {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] 'nvme version' failed. Not Retrying. {{(pid=72954) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] nvme not present on system {{(pid=72954) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Sep 05 00:17:28 user nova-compute[72954]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Sep 05 00:17:28 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bcefaf-093c-4ed7-9957-6e5e497f603a]: (4, '') {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72954) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.lightos [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] LIGHTOS: no hostnqn found. {{(pid=72954) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG os_brick.utils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:77a24c62647a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.virt.block_device [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating existing volume attachment record: a1a0b4f8-a075-4a24-9a00-54adf3dd1179 {{(pid=72954) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Successfully created port: e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Sep 05 00:17:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Successfully updated port: e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquired lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Building network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing instance network info cache due to event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] Acquiring lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:17:29 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Instance cache missing network info. {{(pid=72954) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG nova.network.neutron [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Releasing lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Instance network_info: |[{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72954) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] Acquired lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updated VIF entry in instance network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG nova.network.neutron [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:17:30 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-8544660d-0ab5-48e2-aed5-5a9e51b1e413 req-27971dab-81a6-44e4-be03-c8afc26abb61 service nova] Releasing lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:17:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Start spawning the instance on the hypervisor. {{(pid=72954) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Creating instance directory {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Sep 05 00:17:42 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Creating image(s)
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Did not create local disks {{(pid=72954) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Ensure instance console log exists: /opt/stack/data/nova/instances/f94cdb5d-9607-4569-870a-689f30a7aa27/console.log {{(pid=72954) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Start _get_guest_xml network_info=[{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWCjLreS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f94cdb5d-9607-4569-870a-689f30a7aa27', 'attached_at': '', 'detached_at': '', 'volume_id': '9399929d-fa82-406f-a797-d5a0ba3209fb', 'serial': '9399929d-fa82-406f-a797-d5a0ba3209fb'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a1a0b4f8-a075-4a24-9a00-54adf3dd1179', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Sep 05 00:17:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:17:42 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller missing on host. {{(pid=72954) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.host [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU controller found on host. {{(pid=72954) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72954) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-09-04T23:25:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image limits 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flavor pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Image pref 0:0:0 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72954) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Got 1 possible topologies {{(pid=72954) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.hardware [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72954) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Calling os-brick to attach iSCSI Volume {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWCjLreS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:17:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:17:42 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:17:42 user nova-compute[72954]: INFO os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[80846806-f5e6-4ccd-87f0-d5b67c660f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Sep 05 00:17:42 user nova-compute[72954]:  {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --interface default --op new {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9a45cd-5aa4-4a36-8348-3dfabb6aee65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb] added\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb] added
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdb2b9f-2e9d-4728-b1b3-42fe2874d97c]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[379a27e7-b413-4a58-9cbe-7a071dfa9b90]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWCjLreS {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWCjLreS" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6e56b9-d844-4648-aa9c-79b34714956d]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWCjLreS'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1234e-b778-492b-bdab-31aabc2ee0c8]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[768beac9-1447-4c8d-83cf-80326b37e885]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --login {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3de7e0-f66f-4214-bef2-4e15f07847c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260]
Sep 05 00:17:42 user nova-compute[72954]: Login to [iface: default, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260] successful.
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4145bd-c1f6-4191-b921-2ad214fc8b3a]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[35754b51-45f8-4560-afa4-3fb15ba74e6c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:17:42 user nova-compute[72954]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:17:42 user nova-compute[72954]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)
Sep 05 00:17:42 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to 172.16.0.220:3260 {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72954) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72954) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29e6ac8-983b-4767-9e0b-663c136c3548]: (4, ('- - 0', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72954) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Sep 05 00:17:42 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWCjLreS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72954) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23638313332343333', 'path': '/dev/sdc'} {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638313332343333', 'path': '/dev/sdc'} {{(pid=72954) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778755286',display_name='tempest-TestVolumeBootPattern-server-778755286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778755286',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-un5n2ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:17:28Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f94cdb5d-9607-4569-870a-689f30a7aa27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72954) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.objects.instance [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'pci_devices' on Instance uuid f94cdb5d-9607-4569-870a-689f30a7aa27 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] End _get_guest_xml xml=<domain type="kvm">
Sep 05 00:17:43 user nova-compute[72954]:   <uuid>f94cdb5d-9607-4569-870a-689f30a7aa27</uuid>
Sep 05 00:17:43 user nova-compute[72954]:   <name>instance-00000034</name>
Sep 05 00:17:43 user nova-compute[72954]:   <memory>524288</memory>
Sep 05 00:17:43 user nova-compute[72954]:   <vcpu>1</vcpu>
Sep 05 00:17:43 user nova-compute[72954]:   <metadata>
Sep 05 00:17:43 user nova-compute[72954]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Sep 05 00:17:43 user nova-compute[72954]:       <nova:package version="0.0.0"/>
Sep 05 00:17:43 user nova-compute[72954]:       <nova:name>tempest-TestVolumeBootPattern-server-778755286</nova:name>
Sep 05 00:17:43 user nova-compute[72954]:       <nova:creationTime>2023-09-05 00:17:42</nova:creationTime>
Sep 05 00:17:43 user nova-compute[72954]:       <nova:flavor name="m1.tiny">
Sep 05 00:17:43 user nova-compute[72954]:         <nova:memory>512</nova:memory>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:disk>1</nova:disk>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:swap>0</nova:swap>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:ephemeral>0</nova:ephemeral>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:vcpus>1</nova:vcpus>
Sep 05 00:17:43 user nova-compute[72954]:       </nova:flavor>
Sep 05 00:17:43 user nova-compute[72954]:       <nova:owner>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:user uuid="3cf7d858403844ce8f360f40e57ac51b">tempest-TestVolumeBootPattern-1950575880-project-member</nova:user>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:project uuid="976fc195b97d48a58066e69ccfd0598f">tempest-TestVolumeBootPattern-1950575880</nova:project>
Sep 05 00:17:43 user nova-compute[72954]:       </nova:owner>
Sep 05 00:17:43 user nova-compute[72954]:       <nova:ports>
Sep 05 00:17:43 user nova-compute[72954]:         <nova:port uuid="e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b">
Sep 05 00:17:43 user nova-compute[72954]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Sep 05 00:17:43 user nova-compute[72954]:         </nova:port>
Sep 05 00:17:43 user nova-compute[72954]:       </nova:ports>
Sep 05 00:17:43 user nova-compute[72954]:     </nova:instance>
Sep 05 00:17:43 user nova-compute[72954]:   </metadata>
Sep 05 00:17:43 user nova-compute[72954]:   <sysinfo type="smbios">
Sep 05 00:17:43 user nova-compute[72954]:     <system>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="manufacturer">OpenStack Foundation</entry>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="product">OpenStack Nova</entry>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="version">0.0.0</entry>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="serial">f94cdb5d-9607-4569-870a-689f30a7aa27</entry>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="uuid">f94cdb5d-9607-4569-870a-689f30a7aa27</entry>
Sep 05 00:17:43 user nova-compute[72954]:       <entry name="family">Virtual Machine</entry>
Sep 05 00:17:43 user nova-compute[72954]:     </system>
Sep 05 00:17:43 user nova-compute[72954]:   </sysinfo>
Sep 05 00:17:43 user nova-compute[72954]:   <os>
Sep 05 00:17:43 user nova-compute[72954]:     <type arch="x86_64" machine="pc">hvm</type>
Sep 05 00:17:43 user nova-compute[72954]:     <boot dev="hd"/>
Sep 05 00:17:43 user nova-compute[72954]:     <smbios mode="sysinfo"/>
Sep 05 00:17:43 user nova-compute[72954]:   </os>
Sep 05 00:17:43 user nova-compute[72954]:   <features>
Sep 05 00:17:43 user nova-compute[72954]:     <acpi/>
Sep 05 00:17:43 user nova-compute[72954]:     <apic/>
Sep 05 00:17:43 user nova-compute[72954]:     <vmcoreinfo/>
Sep 05 00:17:43 user nova-compute[72954]:   </features>
Sep 05 00:17:43 user nova-compute[72954]:   <clock offset="utc">
Sep 05 00:17:43 user nova-compute[72954]:     <timer name="pit" tickpolicy="delay"/>
Sep 05 00:17:43 user nova-compute[72954]:     <timer name="rtc" tickpolicy="catchup"/>
Sep 05 00:17:43 user nova-compute[72954]:     <timer name="hpet" present="no"/>
Sep 05 00:17:43 user nova-compute[72954]:   </clock>
Sep 05 00:17:43 user nova-compute[72954]:   <cpu mode="custom" match="exact">
Sep 05 00:17:43 user nova-compute[72954]:     <model>Nehalem</model>
Sep 05 00:17:43 user nova-compute[72954]:     <topology sockets="1" cores="1" threads="1"/>
Sep 05 00:17:43 user nova-compute[72954]:   </cpu>
Sep 05 00:17:43 user nova-compute[72954]:   <devices>
Sep 05 00:17:43 user nova-compute[72954]:     <disk type="block" device="disk">
Sep 05 00:17:43 user nova-compute[72954]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Sep 05 00:17:43 user nova-compute[72954]:       <source dev="/dev/sdc"/>
Sep 05 00:17:43 user nova-compute[72954]:       <target dev="vda" bus="virtio"/>
Sep 05 00:17:43 user nova-compute[72954]:       <serial>9399929d-fa82-406f-a797-d5a0ba3209fb</serial>
Sep 05 00:17:43 user nova-compute[72954]:     </disk>
Sep 05 00:17:43 user nova-compute[72954]:     <interface type="ethernet">
Sep 05 00:17:43 user nova-compute[72954]:       <mac address="fa:16:3e:33:ee:f0"/>
Sep 05 00:17:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:17:43 user nova-compute[72954]:       <mtu size="1442"/>
Sep 05 00:17:43 user nova-compute[72954]:       <target dev="tape7f5b8af-9b"/>
Sep 05 00:17:43 user nova-compute[72954]:     </interface>
Sep 05 00:17:43 user nova-compute[72954]:     <serial type="pty">
Sep 05 00:17:43 user nova-compute[72954]:       <log file="/opt/stack/data/nova/instances/f94cdb5d-9607-4569-870a-689f30a7aa27/console.log" append="off"/>
Sep 05 00:17:43 user nova-compute[72954]:     </serial>
Sep 05 00:17:43 user nova-compute[72954]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Sep 05 00:17:43 user nova-compute[72954]:     <video>
Sep 05 00:17:43 user nova-compute[72954]:       <model type="virtio"/>
Sep 05 00:17:43 user nova-compute[72954]:     </video>
Sep 05 00:17:43 user nova-compute[72954]:     <rng model="virtio">
Sep 05 00:17:43 user nova-compute[72954]:       <backend model="random">/dev/urandom</backend>
Sep 05 00:17:43 user nova-compute[72954]:     </rng>
Sep 05 00:17:43 user nova-compute[72954]:     <controller type="usb" index="0" model="none"/>
Sep 05 00:17:43 user nova-compute[72954]:     <memballoon model="virtio">
Sep 05 00:17:43 user nova-compute[72954]:       <stats period="10"/>
Sep 05 00:17:43 user nova-compute[72954]:     </memballoon>
Sep 05 00:17:43 user nova-compute[72954]:   </devices>
Sep 05 00:17:43 user nova-compute[72954]: </domain>
Sep 05 00:17:43 user nova-compute[72954]:  {{(pid=72954) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778755286',display_name='tempest-TestVolumeBootPattern-server-778755286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778755286',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-un5n2ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-09-05T00:17:28Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f94cdb5d-9607-4569-870a-689f30a7aa27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG os_vif [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b') {{(pid=72954) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f5b8af-9b, may_exist=True, interface_attrs={}) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f5b8af-9b, col_values=(('external_ids', {'iface-id': 'e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:ee:f0', 'vm-uuid': 'f94cdb5d-9607-4569-870a-689f30a7aa27'}),), if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:43 user nova-compute[72954]: INFO os_vif [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b')
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No BDM found with device name vda, not building metadata. {{(pid=72954) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Sep 05 00:17:43 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] No VIF found with MAC fa:16:3e:33:ee:f0, not building metadata {{(pid=72954) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Sep 05 00:17:44 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:44 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:44 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG nova.compute.manager [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] No waiting events found dispatching network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:17:45 user nova-compute[72954]: WARNING nova.compute.manager [req-dff2ef84-900e-4e44-aad5-e0e092011ac2 req-9efbb468-e476-4fdd-97ac-6b201ce38981 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received unexpected event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b for instance with vm_state building and task_state spawning.
Sep 05 00:17:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:17:45 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:17:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:17:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=25.122272491455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e394265d-c884-487b-80a3-8a99ed1362c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f94cdb5d-9607-4569-870a-689f30a7aa27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:17:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693873067.2801003, f94cdb5d-9607-4569-870a-689f30a7aa27 => Resumed> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] VM Resumed (Lifecycle Event)
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Instance event wait completed in 0 seconds for  {{(pid=72954) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Guest created on hypervisor {{(pid=72954) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Instance spawned successfully.
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_cdrom_bus of ide {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_disk_bus of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_input_bus of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_pointer_model of None {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_video_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Found default for hw_vif_model of virtio {{(pid=72954) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.virt.driver [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] Emitting event <LifecycleEvent: 1693873067.28121, f94cdb5d-9607-4569-870a-689f30a7aa27 => Started> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] VM Started (Lifecycle Event)
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72954) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-9474658a-2e77-44b0-85aa-1b35a2d9c6f3 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] During sync_power_state the instance has a pending task (spawning). Skip.
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Took 5.00 seconds to spawn the instance on the hypervisor.
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:17:47 user nova-compute[72954]: INFO nova.compute.manager [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Took 19.68 seconds to build instance.
Sep 05 00:17:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-0d7dc728-8194-4fd2-b7d8-bfacad2fef93 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.782s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:17:47 user nova-compute[72954]: DEBUG nova.compute.manager [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] No waiting events found dispatching network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:17:47 user nova-compute[72954]: WARNING nova.compute.manager [req-d618727d-fc9f-4cdf-9f9d-55ccb1e8e1d8 req-3a2c654d-5785-45e6-b830-cdbf4c080db6 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received unexpected event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b for instance with vm_state active and task_state None.
Sep 05 00:17:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:50 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:53 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:17:55 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:55 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:56 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:17:58 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:17:59 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:17:59 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:17:59 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:18:02 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:07 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:12 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:17 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:23 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:27 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:33 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:38 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:18:43 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:18:45 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:18:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:18:45 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:18:45 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:18:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:18:46 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.121124267578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e394265d-c884-487b-80a3-8a99ed1362c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance f94cdb5d-9607-4569-870a-689f30a7aa27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:18:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:18:48 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:18:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:53 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:18:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:54 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:18:57 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:57 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:18:58 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:00 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:19:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:19:03 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:19:08 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:13 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:18 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:19:19 user nova-compute[72954]: DEBUG nova.compute.manager [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing instance network info cache due to event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:19:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] Acquiring lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:19:19 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] Acquired lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:19:19 user nova-compute[72954]: DEBUG nova.network.neutron [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updated VIF entry in instance network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-6817b387-3aa6-4cab-bb74-36885a51c026 req-e1850a4b-0f31-46d6-a42a-255731f169ef service nova] Releasing lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.compute.manager [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing instance network info cache due to event network-changed-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] Acquiring lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] Acquired lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Refreshing network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:20 user nova-compute[72954]: INFO nova.compute.manager [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Terminating instance
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.compute.manager [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updated VIF entry in instance network info cache for port e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG nova.network.neutron [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [{"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-16b53204-0b43-4748-9e69-12e069be1781 req-f0974656-fb34-4922-a6c0-05af95d49cd5 service nova] Releasing lock "refresh_cache-f94cdb5d-9607-4569-870a-689f30a7aa27" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:20 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Instance destroyed successfully.
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.objects.instance [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid f94cdb5d-9607-4569-870a-689f30a7aa27 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778755286',display_name='tempest-TestVolumeBootPattern-server-778755286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-778755286',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-un5n2ntx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:17:47Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=f94cdb5d-9607-4569-870a-689f30a7aa27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "address": "fa:16:3e:33:ee:f0", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f5b8af-9b", "ovs_interfaceid": "e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_vif [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f5b8af-9b, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:21 user nova-compute[72954]: INFO os_vif [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ee:f0,bridge_name='br-int',has_traffic_filtering=True,id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f5b8af-9b')
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWCjLreS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:19:21 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4206b-9ed6-43df-acb6-269b9aacc788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34e8fad-bce0-4a70-899d-aba691b4a81a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:19:21 user nova-compute[72954]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)
Sep 05 00:19:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:19:21 user nova-compute[72954]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb (non-flash)
Sep 05 00:19:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd13f05e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb'): ({'sdc'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdc {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec20f53-b569-49fb-97be-6d12842db623]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878b66a-5ab2-4217-bfc5-89fc8acb5b4b]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdc {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f68f04-be01-4760-a929-1c74c54fe26b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0fb4cf-5067-452f-885d-0110f889a41b]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdc have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb385c5b9-68132433088e1024', '/dev/disk/by-id/scsi-23638313332343333', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b385c5b9') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d90f58-ec1c-40a0-ad50-6d28809251f3]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f42f4-f02f-4935-96c2-8c06ee2b0262]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e14898-a9c1-4c00-9f09-9ba0a318ccc3]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260]
Sep 05 00:19:21 user nova-compute[72954]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb, portal: 172.16.0.220,3260] successful.
Sep 05 00:19:21 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9399929d-fa82-406f-a797-d5a0ba3209fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc8c61-378c-47bc-82ec-03f6567c093b]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (305ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:19:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Deleting instance files /opt/stack/data/nova/instances/f94cdb5d-9607-4569-870a-689f30a7aa27_del
Sep 05 00:19:21 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Deletion of /opt/stack/data/nova/instances/f94cdb5d-9607-4569-870a-689f30a7aa27_del complete
Sep 05 00:19:21 user nova-compute[72954]: INFO nova.compute.manager [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Took 1.15 seconds to destroy the instance on the hypervisor.
Sep 05 00:19:21 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:19:21 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:19:22 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Took 0.40 seconds to deallocate network for instance.
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5c69202-44aa-4a8f-80ef-7318178aed99 req-fd3ff0e0-ae71-477e-ad24-59ac06fb2f98 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-deleted-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:19:22 user nova-compute[72954]: INFO nova.compute.manager [req-c5c69202-44aa-4a8f-80ef-7318178aed99 req-fd3ff0e0-ae71-477e-ad24-59ac06fb2f98 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Neutron deleted interface e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b; detaching it from the instance and deleting it from the info cache
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.network.neutron [req-c5c69202-44aa-4a8f-80ef-7318178aed99 req-fd3ff0e0-ae71-477e-ad24-59ac06fb2f98 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-c5c69202-44aa-4a8f-80ef-7318178aed99 req-fd3ff0e0-ae71-477e-ad24-59ac06fb2f98 service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Detach interface failed, port_id=e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b, reason: Instance f94cdb5d-9607-4569-870a-689f30a7aa27 could not be found. {{(pid=72954) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10942}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-unplugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] No waiting events found dispatching network-vif-unplugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-unplugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Acquiring lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:22 user nova-compute[72954]: DEBUG nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] No waiting events found dispatching network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:19:22 user nova-compute[72954]: WARNING nova.compute.manager [req-dd0dc46c-3b20-448b-9204-7ab25cf1679b req-040bd4c4-87d4-4db9-ac3a-21cd6fd6e52c service nova] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Received unexpected event network-vif-plugged-e7f5b8af-9b2d-4eb0-88fd-579c4e7ff82b for instance with vm_state active and task_state deleting.
Sep 05 00:19:23 user nova-compute[72954]: INFO nova.compute.manager [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Took 0.99 seconds to detach 1 volumes for instance.
Sep 05 00:19:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:23 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:19:23 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:19:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:23 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance f94cdb5d-9607-4569-870a-689f30a7aa27
Sep 05 00:19:23 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-56171233-86a7-4974-b1b2-6aab160c96d6 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "f94cdb5d-9607-4569-870a-689f30a7aa27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.874s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:36 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693873161.2526789, f94cdb5d-9607-4569-870a-689f30a7aa27 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:19:36 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] VM Stopped (Lifecycle Event)
Sep 05 00:19:36 user nova-compute[72954]: DEBUG nova.compute.manager [None req-f26b2f59-6fc2-449d-83eb-8f9c584a2dbd None None] [instance: f94cdb5d-9607-4569-870a-689f30a7aa27] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:19:36 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:19:41 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72954) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Sep 05 00:19:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:19:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=25.1202392578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Instance e394265d-c884-487b-80a3-8a99ed1362c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72954) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:19:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:51 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:55 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:55 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:19:56 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:19:57 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:19:59 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Forcefully refreshing network info cache for instance {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Sep 05 00:20:01 user nova-compute[72954]: DEBUG nova.objects.instance [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lazy-loading 'info_cache' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:20:02 user nova-compute[72954]: DEBUG nova.network.neutron [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:20:02 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:20:02 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated the network info_cache for instance {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9976}}
Sep 05 00:20:06 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:11 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:16 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:21 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:26 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:28 user nova-compute[72954]: INFO nova.compute.manager [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Terminating instance
Sep 05 00:20:28 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Start destroying the instance on the hypervisor. {{(pid=72954) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG nova.compute.manager [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing instance network info cache due to event network-changed-b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11113}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] Acquiring lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] Acquired lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Refreshing network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:28 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-unplugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] No waiting events found dispatching network-vif-unplugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.compute.manager [req-9aebdbcd-dbd2-4200-b52d-fa4941da5783 req-398fa8f3-d15e-457b-ae0b-202f09e56bf3 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-unplugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 for instance with task_state deleting. {{(pid=72954) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10886}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updated VIF entry in instance network info cache for port b0d4fb51-edaa-4285-9229-279bafddc7b7. {{(pid=72954) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.network.neutron [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [{"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-4b9e80ab-6bd8-4ca4-a9f1-5bb49347d31c req-669b42a8-6a83-4aec-9cab-5ea6b08f5ae7 service nova] Releasing lock "refresh_cache-e394265d-c884-487b-80a3-8a99ed1362c3" {{(pid=72954) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Sep 05 00:20:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Instance destroyed successfully.
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.objects.instance [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lazy-loading 'resources' on Instance uuid e394265d-c884-487b-80a3-8a99ed1362c3 {{(pid=72954) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.vif [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-09-05T00:15:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1382327239',display_name='tempest-TestVolumeBootPattern-server-1382327239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1382327239',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyzQasHRH499OjmhK2DiU6Jqyc74ZiGQyW8V0clTuaBasQ3Xg2QUFINXpyT4LJZqmERz8I0A9S4OtCTWgsEgEBYwBauDb+muRfxYBay1FxGkcirbAhd70oq77cM2AuyOA==',key_name='tempest-TestVolumeBootPattern-413627213',keypairs=<?>,launch_index=0,launched_at=2023-09-05T00:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='976fc195b97d48a58066e69ccfd0598f',ramdisk_id='',reservation_id='r-n0pfv06b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1950575880',owner_user_name='tempest-TestVolumeBootPattern-1950575880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-09-05T00:15:38Z,user_data=None,user_id='3cf7d858403844ce8f360f40e57ac51b',uuid=e394265d-c884-487b-80a3-8a99ed1362c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converting VIF {"id": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "address": "fa:16:3e:35:a7:39", "network": {"id": "5a30cc09-9b10-4484-8001-b3efdf5d1926", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992613336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "976fc195b97d48a58066e69ccfd0598f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d4fb51-ed", "ovs_interfaceid": "b0d4fb51-edaa-4285-9229-279bafddc7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.network.os_vif_util [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed') {{(pid=72954) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_vif [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed') {{(pid=72954) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0d4fb51-ed, bridge=br-int, if_exists=True) {{(pid=72954) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:29 user nova-compute[72954]: INFO os_vif [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:a7:39,bridge_name='br-int',has_traffic_filtering=True,id=b0d4fb51-edaa-4285-9229-279bafddc7b7,network=Network(5a30cc09-9b10-4484-8001-b3efdf5d1926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d4fb51-ed')
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] calling os-brick to detach iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd13026a200>, {'target_iqns': ['iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRTBHipJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Sep 05 00:20:29 user nova-compute[72954]: WARNING os_brick.initiator.connectors.base [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973', 0)] {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f731c4-ce7e-444a-8ae4-1ad2558ef506]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6261db-b027-4996-ad11-4e28b4e6624e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:20:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 (non-flash)
Sep 05 00:20:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd118349ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973'): ({'sdb'}, set())}) {{(pid=72954) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Removing single pathed devices sdb {{(pid=72954) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc8b961-6142-4798-8d5d-543a13a7789d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b41fc0-116a-4217-b5e0-6cb45f5d9b4a]: (4, ('ok\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Flushing IO for device /dev/sdb {{(pid=72954) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd213bb-2723-4452-815e-765c049485bf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72954) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[178be042-616c-4502-a6f9-7ed020764b9a]: (4, ('1', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.linuxscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] SCSI volumes sdb have been removed. {{(pid=72954) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26362663334323230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9ea9435f', '/dev/disk/by-id/scsi-1SCST_BIO9ea9435f-cbf34220ff12eddf') {{(pid=84490) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf1853-d11a-4328-8b6b-8b9c75e954bb]: (4, None) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973')] {{(pid=72954) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[997c210f-1186-49c3-99c5-2f1a818a93c7]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --logout {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[06686849-1ac4-4fe1-933f-b1a405580ca8]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260]
Sep 05 00:20:29 user nova-compute[72954]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973, portal: 172.16.0.220,3260] successful.
Sep 05 00:20:29 user nova-compute[72954]:  stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op delete {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:414f99c3-e370-4417-b734-8093c5312973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84490) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f747ff-676b-403f-98af-bb2a39882bdf]: (4, ('', '')) {{(pid=84490) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72954) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.base [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] <== disconnect_volume: return (272ms) None {{(pid=72954) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Disconnected iSCSI Volume {{(pid=72954) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Sep 05 00:20:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Deleting instance files /opt/stack/data/nova/instances/e394265d-c884-487b-80a3-8a99ed1362c3_del
Sep 05 00:20:29 user nova-compute[72954]: INFO nova.virt.libvirt.driver [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Deletion of /opt/stack/data/nova/instances/e394265d-c884-487b-80a3-8a99ed1362c3_del complete
Sep 05 00:20:29 user nova-compute[72954]: INFO nova.compute.manager [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Took 1.13 seconds to destroy the instance on the hypervisor.
Sep 05 00:20:29 user nova-compute[72954]: DEBUG oslo.service.loopingcall [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72954) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.compute.manager [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Deallocating network for instance {{(pid=72954) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Sep 05 00:20:29 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] deallocate_for_instance() {{(pid=72954) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Sep 05 00:20:30 user nova-compute[72954]: DEBUG nova.network.neutron [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Updating instance_info_cache with network_info: [] {{(pid=72954) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Sep 05 00:20:30 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Took 0.50 seconds to deallocate network for instance.
Sep 05 00:20:30 user nova-compute[72954]: DEBUG nova.compute.manager [req-83b52ab8-c5d6-4093-8e62-d32bb58385a4 req-14a8dd4f-c2dd-483e-94a4-7ab7a44e4b29 service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-deleted-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) external_instance_event /opt/stack/nova/nova/compute/manager.py:11108}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] Acquiring lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] Lock "e394265d-c884-487b-80a3-8a99ed1362c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG nova.compute.manager [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] No waiting events found dispatching network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 {{(pid=72954) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Sep 05 00:20:31 user nova-compute[72954]: WARNING nova.compute.manager [req-c0f06f57-13d2-4eab-ba5a-c2422809e814 req-d0f91c1b-8d02-4718-8880-133b0775e8fb service nova] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Received unexpected event network-vif-plugged-b0d4fb51-edaa-4285-9229-279bafddc7b7 for instance with vm_state active and task_state deleting.
Sep 05 00:20:31 user nova-compute[72954]: INFO nova.compute.manager [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Took 0.83 seconds to detach 1 volumes for instance.
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:31 user nova-compute[72954]: INFO nova.scheduler.client.report [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Deleted allocations for instance e394265d-c884-487b-80a3-8a99ed1362c3
Sep 05 00:20:31 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-a7e6a954-1943-4fb4-93a1-e00ec3b71b47 tempest-TestVolumeBootPattern-1950575880 tempest-TestVolumeBootPattern-1950575880-project-member] Lock "e394265d-c884-487b-80a3-8a99ed1362c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:20:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:44 user nova-compute[72954]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693873229.4267128, e394265d-c884-487b-80a3-8a99ed1362c3 => Stopped> {{(pid=72954) emit_event /opt/stack/nova/nova/virt/driver.py:1679}}
Sep 05 00:20:44 user nova-compute[72954]: INFO nova.compute.manager [-] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] VM Stopped (Lifecycle Event)
Sep 05 00:20:44 user nova-compute[72954]: DEBUG nova.compute.manager [None req-a51d5523-c385-4438-9b69-e3e11b6c7fb6 None None] [instance: e394265d-c884-487b-80a3-8a99ed1362c3] Checking state {{(pid=72954) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Sep 05 00:20:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:20:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:20:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.119312286376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:20:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:20:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:52 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:53 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:20:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:20:57 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:57 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:20:57 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72954) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10524}}
Sep 05 00:20:59 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:00 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:03 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Starting heal instance info cache {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9905}}
Sep 05 00:21:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Rebuilding the list of instances to heal {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9909}}
Sep 05 00:21:03 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Didn't find any instances for network info cache update. {{(pid=72954) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9991}}
Sep 05 00:21:04 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:04 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11205}}
Sep 05 00:21:04 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] There are 0 instances to clean {{(pid=72954) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11214}}
Sep 05 00:21:09 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72954) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72954) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Sep 05 00:21:14 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:18 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:18 user nova-compute[72954]: DEBUG nova.compute.manager [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72954) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11243}}
Sep 05 00:21:19 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:24 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:29 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:30 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:31 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:33 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:34 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:39 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:44 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:46 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:21:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:21:46 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:21:46 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Auditing locally available compute resources for user (node: user) {{(pid=72954) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Sep 05 00:21:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:21:47 user nova-compute[72954]: WARNING nova.virt.libvirt.driver [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.11672592163086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72954) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72954) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing inventories for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating ProviderTree inventory for provider 1011a3ca-a5c6-4712-8224-4088238dab96 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Updating inventory in ProviderTree for provider 1011a3ca-a5c6-4712-8224-4088238dab96 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing aggregate associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, aggregates: None {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Refreshing trait associations for resource provider 1011a3ca-a5c6-4712-8224-4088238dab96, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=72954) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.provider_tree [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed in ProviderTree for provider: 1011a3ca-a5c6-4712-8224-4088238dab96 {{(pid=72954) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.scheduler.client.report [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Inventory has not changed for provider 1011a3ca-a5c6-4712-8224-4088238dab96 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72954) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG nova.compute.resource_tracker [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Compute_service record updated for user:user {{(pid=72954) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Sep 05 00:21:47 user nova-compute[72954]: DEBUG oslo_concurrency.lockutils [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=72954) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Sep 05 00:21:49 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Sep 05 00:21:54 user nova-compute[72954]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72954) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Sep 05 00:21:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:54 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 05 00:21:58 user nova-compute[72954]: DEBUG oslo_service.periodic_task [None req-395d4c93-82df-46fa-b273-e04a1f108d05 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72954) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}